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ABSTRACT 

. ^ ^ The University of Virginia's Outreach Nursing Program 

IS described and evaluated. Information is provided on the results of 
a needs assessment, a feasibility study, and the early history of the 
off-campus program. Attention is directed to the geography of the 
outreach program area, the group of nurses from which the first class 
was selected, course offerings, faculty, and enrollments. The degree 
to which the program objectives were reached is examined. Objectives 
include the following: expanding opportunity for graduate education 
in Southwest Virginia, focusing on medical-surgical nursing and also 
on education, clinical specialties, and administration; developing 
faculty members and additional graduate educated nurses for service 
in the rural setting; and improving the overall quality of nursing 
care in the area. Evaluation efforts were also directed to the direct 
instructional costs of the off-campus program, using student credit 
hours; and average academic degree program costs for a student. The 
following benefits of the program were also evaluated: personal and 
social economic benef its/noneconomic benefits for students, faculty, 
the nursing school and the University of Virginia, and the community. 
Negative outcomes and problems as reported by students, faculty, 
advisory committee members, and nursing school administrators were 
also determined. Among the conclusions was that the institutional and 
professional relationships resulting from the Outreach Program were 
important outcomes. Overall program accountability and the methods 
used for program evaluation are discussed, and a bibliography, 
questionnaires and interview forms, a list of students and advisory 
committee members, and a list of thesis and project titles are 
appended, (SW) 
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FOREWORD 

When planning began for the Outreach Nursing Program ;n the 
mld-1970's, we were excited about the many opportunities such a venture 
would afford us as a school and as a faculty. Primarily, the Outreach 
Program allowed us the opportunity to respond to the educational needs 
for graduate education for a large number of qualified citizens of the 
Commonwealth geographically distant from the educational institution 
offering graduate nursing education—and in this respect allowed us to 
meet one of the major goals of the University of Virginia. Many of the 
Outreach students could not have engaged in graduate nursing educa- 
tion without this program. Another important opportunity was to be- 
come involved in cooperative planning and implementation of the orogram 
with the only other state-supported university school of nursing offer- 
ing graduate nursing education at that time. This Fr.terinstitutional 
cooperation was indeed a positive experience for us. As those of us 
who have been involved in nursing education for any length of time 
know, such cooperation can be a rare occurrence. 

in the spring of 1981, twenty-two graduates of the Outreach 
Program received their degrees at the University of Virginia. When the 
program is finished, more than thirty nurses will have received master's 
degrees from the University which they might otherwise never have had 
the chance to pursue. More than a dozen others will have been able to 
extend their education beyond the baccalaureate degree through access 
to the Outreach Program. The communities in which these nurses work 
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will undoubtedly be served better as a result of their expanded educa- 
tional experiences. The School of Nursing gains as well in the accumu- 
lated knowledge and experience collected throughout the duration of 
this innovative program. 

This report shows that most of the objectives set forth during the 
planning stage of this program have been met. Our efforts will con- 
tinue in the coming months to collect more information about our long- 
term successes and shortcomings. The objective of this continuing 
evaluation will be to assess the ways in which programs similar to the 
University of Virginia Outreach Program can be made more efficient in 
operation and more accessible to the regions and students who need 
such programs most. 

As always, our goal is to enhance the quality of nursing care 
through expanded and improved nursing education. It is our belief 
that the Outreach Program has helped us toward that goal. Our hope 
is that this Evaluation Report will be of help to otherci in pointing out 
both the value and the pitfalls of off-campus instruction. 

The program has always been a challenge, at times a trial, and 
truly rewarding because of the commitment of the faculty and students 
involved. 



Rose Marie Chioni, Ph.D., Dean 
School of Nursing 
University of Virginia 
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PREFACE 

In developing a conceptual framework for evaluating the Outreach 
Program, a very important concern was that the report be easily under- 
stood by academic managers in nursing schools and by other decision 
makers in higher education institutions. The evaluation strategy was to 
be straightforward in the sense that the procedures could be followed 
by others with degree program concerns. The strategy was also con- 
ceived to be comprehensive in the sense that essential facets of plan- 
ning and implementation were considered. 

As one reads the report it is obvious that rigorous statistical 
methods, both in measurements and analysis, are missing. This alter- 
native was selected in part because of the audiencj for whom the report 
is intended. While the literature on evaluation methods contains an 
abundance of quantitative methods for analyzing data, numerous sugges- 
tions of forms designed to collect information for study and judgment, 
and all sorts of diagrams and schemes depicting systems approaches, it 
leaves one with the impression that evaluation is more concerned with 
procedure than with helping academic managers to understand and use 
information in making good decisions. 

As indicated in the evaluation report, a summative or outcomes 
approach was taken. There are two reasons for this: 1), the eval- 
uation team was appointed near the end of the project. And, 2) forma- 
tive or process evaluation was not an important issue in this project. 
Formative evaluation has historically been the responsibility of the 
faculty. They have accepted this duty well and are in a better 
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position to detect and correct weaknesses in program process. It is 
unusual that any external evaluator has the expertise, experience, 
insight and knowJedge to appraise the academic processes of degree 
programs. However, an external evaluator is in a much better position 
to observe, r«5cord and interpret outcomes of programs and compare 
these with expectations. The role of an external evaluation in measur- 
ing outcomes should, therefore, be combined with the expertise of 
faculty members and admi.iistrators who can focus on the quality of 
academic processes. 

The evaluation strategy developed for the Outreach Program ad- 
dressed five basic issues. These were (1) To what extent were the 
program goals and objectives met? (EFFECTIVENESS) (2) How much 
did the program cost to produce certain desired outputs? (EFFICIENCY) 
(3) What were the positive outcomes of the degree program? (BENE- 
FITS) (4) What were the negative experiences of the program? (NEG- 
ATIVE OUTCOMES) and (5) Was the program worth the effort and cost? 
(OVERALL PROGRAM ACCOUNTABILITY) 

The approach used in evaluating the Outreach Program was organ- 
ized in the following sequence: identifying and specifying the problem; 
identifying and specifying student needs; assessment of institution's 
mission in relation to student needs; assessment of program feasibility; 
developing degree program and acquisition of human, financial and 
physical resources; allocation of these resources; and implementation of 
degree program and evaluation of program outcomes. 

In Section I the problem of the Outreach Project was identified as 
a serious deficiency in the numbers of graduate level prepered nurses. 
The shortage extended into areas of nursing service, faculty and 
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research. Surveys revealed that nurses without graduate degrees 
identified problems of accessibility to campus programs and job responsi- 
bilities as prime causes for not being able to raise their le ji of educa- 
tion. The prospect of conducting an off -campus graduate nursing 
program was viewed as a part of the mission of the University of Vir- 
ginia. Thus, the problem of attacking the shortage of nurses prepared- 
at the graduate level was accepted by the School of Nurring. 

A needs assessment was conducted to identify whether there were 
adequate numbers of potential students with interest in pursuing a 
master's degree program. Findings of the constituent groups revealed 
an interest in medical-surgical nursing with a minor in the functional 
area of education. The southwestern part of the state was revealed to 
have the most difficult problems of accessible degree programs offered 
to full-time employed nurses. 

In order to place a graduate program to meet the constituents' 
needs, a feasibility study was conducted to obtain information on actual 
numbers and location of potential students, areas of program interest, 
financial support, community resources available, faculty resources and 
other resources desired to conduct an off-campus program. 

A curriculum plan was developed for a master's degree in nursing 
to meet students' needs. Methods and procedures for program imple- 
mentation were developed. Resources were acquired and allocated in 
terms of faculty, finances and community facilities. 

Section II is a description of the Outreach Program. Students, 
faculty, course descriptions and enrollments are detailed to provide the 
reader a frame of reference for the subsequent section. 



The evaluation strategy is described in Section Mi. The remaining 
five sections report on evaluation methods used, findings and discus- 
sions of effectiveness, costs, benefits, negative outcomes and overall 
program accountability of the Outreach Program. 

In summary, this evaluation report represents the culmination of 
the major effort of assessing the outcomes of the Outreach Program. 
As its conclusions indicate, the major objectives of the program have 
been met. This evaluation has necessarily concentrated on factors 
which could be assessed in the short term. Future evaluation efforts 
will concentrate on developing a structure to assess the long-term 
impacts of the Outreach Program and to determine if the long-range 
objectives specified in the grant proposals and planning documents have 
been accomplished. 

Although the broad goals and program objectives have been met, it 
is clear that anyone wishing to begin a program such as this has prob- 
lems and built-in difficulties to acknowledge. If this report can help 
future off-campus efforts to run more smoothly, it will have served a 
large part of its purpose. 



• 
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SECTION I 

INTRODUCTION AND PROGRAM BACKGROUND 

More than thirty nurses will have completed the University of 
Virginia School of Nursing Graduate Outreach Program when funding 
ceases in June 1982. The efforts which culminated in this new pool of 
master's levei nursing talent for the southwestern Virginia area began 
more than eight years ago. The purpose of this portion of the evalua- 
tion report is to describe how nurses and educators in Virginia identi- 
fied the problem of the shortage of graduate prepared nurses in the 
state and the approach taken toward solving that problem. Details of 
the early history of the Outreach effort are included along with a 
description of the assessment of need and feasibility study portions of 
the project. 

Problem Identification and Statement of Need 

In the early 1970's, the Deans of the Schools of Nursing from the 
Medical College of Virginia-Virginia Commonwealth University and the 
University of Virginia began to discuss ways in which cooperative 
planning for extending statewide opportunities in graduate nursing 
education might take place. These discussions revealed the concern of 
both schools that a serious deficiency in the numbers of master's pre- 
pared nurses existed. By the time the two schools came together for 
planning efforts, the need had been documented in several ways. 

A recently completed survey of graduate education needs in nurs- 
ing In fourteen southern states was described in Graduate Education in 
Nursing in the South , A Report to the Southern Regional Education 
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Board (Nahm, 1971)* This survey focused upon existing and future 
needs in nursing education* The evidence submitted pointed clearly to 
the need for expansion of graduate education in nursing • 

Nahm (1971) stated that the lack of prepared faculty for educa- 
tional programs in nursing is one of the most serious problems in nurs- 
ing in the South* Severe shortages of nurses prepared for new and 
expanding responsibilities in patient care were also indicated --nurse 
clinicians and practitioners, administrators for educational programs and 
complex nursing service areas, and nurses who could provide leadership 
in improving patient care. Preparation for these roles, critical in light 
of rapid social and technological change, appropriately takes place at 
the graduate education leveL 

One recommendation of the Nahm Report suggested the development 
of coop<;rative planning for expansion of graduate education among 
schools of nursing within and between states. Cooperative planning 
among schools, (a consortium), was becoming a popular concept in the 
literature of higher education. The consortium concept encouraged 
more effective utilization of available resources, avoidance of duplication 
of educational offerings, and financial savings. Nahm (1971) suggested 
that cooperative planning among schools of nursing would result in the 
development of imaginative new programs and of new teaching methods 
and techniques. The efficiency of the consortium concept had been 
tested nationally, with cooperative programs already in place in Califor- 
nia, Nevada, Michigan, New York, and Tennessee. 

In 1973, the General Assembly of Virginia amended the Code of 
Virginia to provide for the formation of six regional consortia districts 
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for continuing education. The purpose of this amendment was tc pro- 
vide for expanded opportunities in continuing education (credit and 
non-credit offerings) through interinstitutional cooperation. Inherent In 
the planning for educational consortia was the intent to provide maxi- 
mum interchangeability of credits and to facilitate the earning of de- 
grees by continuing education students. 

Membership In each consortium was composed of all state-supported 
institutions of higher education and any privately-supported colleges 
and universities which elected to join, all within the designated boun- 
daries of that consortium district. The state university located within 
each district served as the focal Institution for that district and main- 
tained organizational offices and personnel. An additional mechanism 
was provided for meeting educational needs if Institutions within a 
consortium district were not able to do so. The University of Virginia 
and ^'Irginia Polytechnic Institute and State University have been des- 
ignated as comprehensive universities and may deliver programs in any 
consortium district requesting such assistance. 

In addition to endorsing the existing state system of regional 
consortia as a legitimate approach through which nursing education in 
Virginia could be expanded, discussions with a variety of agencies and 
schools were held to determine interest, support, and need for graduate 
education. Some of the agencies consulted were: 

1. State Council of Higher Education for Virginia 

2. The Virginia State Board of Nursing 

3. The Virginia Nurses' Association 

4. The Virginia League for Nursing 
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5. Virginia Hospital Association 

6. State and private senior colleges throughout Virginia 

7. State community colleges throughout Virginia 

These discussions provided positive and enthusiastic encouragement to 
proceed with planning efforts. 

Although national and state statistics regarding educational prep- 
aration of faculty in the schools of nursing in Virginia were available, 
there were no accurate figures regarding the number of master's pre- 
pared nurses in nursing service positions nor the number of positions 
requiring such preparation. Therefore, a state-wide study of manpov;er 
needs in nursing was initiated by the State Council of Higher Education 
for Virginia to obtain data on current and projected needs for master's 
and doctoral ly prepared nurses in nursing service and research posi- 
tions as well as in nursing education. 

The membership of some of the Virginia Nurses' Association dist- 
ricts, already engaging in local surveys of graduate education needs, 
was actively pursuing avenues for extended programs. Nurses through- 
out the state identified problems of accessibility to established campus 
programs because of geographic distance and job responsibilities as well 
as home and family responsibilities. Off-campus courses had been 
offered by both university schools of nursing. In the summer of 1973, 
Virginia Commonwealth University offered undergraduate study in psych- 
iatric-mental health nursing in Northern Virginia. The course outline 
was reviewed by the faculties of the University of Virginia and Virginia 
Commonwealth University and agreement was reached that credit for this 
course would be granted by either university. This offering was 
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viewed as successful by the participants. Graduate courses in curricu- 
lum and teaching strategies offered by the University of Virginia since 
1974 had been received enthusiastically in the seven locations across the 
state where they had been offered. 

Early in the discussion stage regarding the feasibility of develop- 
ing an outreach program, it was believed that a planned avenue for 
communication at the grass-roots level of the nursing profession in 
Virginia would be needed on a continuing basis. The Virginia Nurses' 
Association, with its thirteen constituent districts, seemed a logical and 
appropriate vehicle though which a communication linkage could be 
established between cooperative outreach project planners and nurses 
throughout the state. 

As early as 1974, a meeting was held with the Virginia Nurses' 
Association Council of District Presidents to exchange ideas about 
nursing education needs, share thoughts concerning the possibility of 
expano'ing educational opportunities through off-campus programming, 
and suggest the formation of a Virginia Nurses' Association-Cooperative 
Outreach Project Liaison Committee. The concept of off-campus pro- 
gramming in nursing education was well-received as well as the sug- 
gestion that a liaison committee be formed. Some of the council members 
indicated their district memberships were already gathering data re- 
garding educational needs and interest was high in promoting an ex- 
pansion of educational opportunities. 

By April 1975, twelve of the thirteen district associations of the 
Virginia Nurses' Association had selected their representatives for the 
Virginia Nurses' Association-Cooperative Outreach Project Liaison Com- 
mittee. The Committee was co-chaired by one representative from the 



University of Virginia School of Nursing and one from the Virginia 
Commonwealth University-Medical College of Virginia School of Nursing. 

The Liaison Committee convened for its initial meeting on November 
4, 1975, in Williamsburg. Representatives of the State Council of 
Higher Education participated with committee members in a discussion of 
survey data regarding interest in graduate education in nursing and 
planning efforts regarding the proposed Outreach Program. The inter- 
ests, concerns, and ideas generated by the district association repre- 
sentatives confirmed the cooperative outreach project planners' feelings 
that the involvement of nurses a the district level was essential to 
state- wide planning efforts. The formation of the Liaison Committee was 
a sound decision and the committee served effectively as a communica- 
tion channel with nurses thoughout the state. 
Feasibility Study 

Because of the absence of data necessary to plan a graduate 
outreach program, the Deans of the two university schools of nursing 
requested a comprehensive study of the needs and interests of bacca- 
laureate nurses for graduate nursing education. The study was con- 
ducted by the State Council of Higher Education for Virginia in collab- 
oration with the Virginia State Board of Nursing and the faculties of 
the two university schools of nursing • Registered Nurse Licensure data 
of August 1975, revealed that 3,977 licensed nurses in Virgiffja reported 
a bacccalaureate degree in nursing as their highest degree. Of this 
number, 2,412 nurses (61%) resided in Virginia but outside the Char- 
lottesville and Richmond areas. An additional 197 nurses reported 
holding a baccalaureate degree in nursing and a non-nursing master's 
degree. Of this number, 127 nurses (64%) resided in Virginia but 
ouside the Charlottesville and Richmond areas. 
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A questionnaire regarding interest in graduate education in nurs- 
ing was developed for distribution to baccalaureate-prepared nurses 
residing in Virginia outside the Charlottesville and Richmond areas. 
Utilizing the "non-ordered" active licensure records of these 2,412 and 
127 nurses referred to above, a systematic 40 percent random sample of 
1,004 nurses was drawn and sent the questionnaire. 

A total of 611 questionnaires (61%) was returned. Of this num- 
ber, an impressive 492 (80.5%) respondents indicated positive interest 
in pursuing graduate education in nursing. 

The data suggested that study in medicai-surgical nursing and the 
functional area of education could be appropriately offered as areas for 
study in all of these six planning districts. 

In April 1975, representatives of the two schools of nursing and 
the Virginia Nurses' Association met with the Advisory Committee on 
Education for Health Professions and Occupations of the State Council of 
Higher Education to discuss the preliminary findings of the survey. A 
proposal to proceed with collaborative efforts was endorsed by the 
Advisory Committee. Several joint meetings between the graduate 
faculties of both schools were held, and agreement was reached to 
proceed to determine the feasibility of joint graduate programming and. 
If found to be feasible, to plan such programs. Those who initially 
discussed the snortage of master's prepared nurses collected other 
information which further documented the extent of the shortage. A 
national inventory of nurses in 1972 had shown that Virginia fell con- 
siderably below the national average in the number of nurses prepared 
at the master's level for roles in teachii administration and clinical 
specialties. The state ranked 31st among the fifty states in nurse to 
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population ratio. This figure pointed to the general shortage of nurses 
at all educational levels. 

The Annual Report of the Virginia State Board of Nursing (1973) 
showed that in the area of education ; while Board rules specified grad- 
uate preparation as a requirement tor faculty in a baccalaureate pro- 
gram and some positions in associate and diploma programs, more than 
58% of all nursing faculty did not hold graduate credentials. 

In 1975, the Advisory Committee on Education for Health Profes- 
sions and Occupations reported these data to the State Council on 
Higher Education for Virginia. That committee included in its report 
results of a survey of registered nurses who were interested in grad- 
uate level study in the Tidewater area. In general, that study showed 
a substantial number of registered nurses seriously interested and 
ready to pursue graduate education in nursing. Because of personal, 
employment, or geocraphical distance concerns, the nurses were unable 
to enroll in either of the on-campus graduate programs in nursing cur- 
rently offered at the University of Virginia or at the Medical College of 
Virginia-Virginia Commonwealth University. 

.A survey of the southwestern Virginia area by the state Depart- 
ment of Health in 1976 yielded similar results. Many nurses in that 
area were also prepared and interested in pursuing graduate level 
education, but for a number of reasons, could not avai! themselves of 
the existing programs in the state. In addition, because of the general 
shortage of nursing educators, there was no prospect for new master's 
level programs being developed at any other state schools in the fore- 
seeable future. 
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Program Planning Phase 

The committee that reviewed the study of the needs and interests 
of baccalaureate nurses for graduate education and various studies 
documenting the shortage of master's prepared nurses saw a number of 
outcomes that could be expected if the problem of the shortage of 
master's U nurses was addressed through off-campus programs 
offered by the two universities with existing graduate nursing pro- 
grams. These outcomes included benefits such as an increased supply 
of prepared nurse educators, clinical specialists, and administrators; 
increased competency of those graduate education enrollees already 
employed in these types of positions; a strengthening of basic nursing 
education programs through increased competency of faculty and addi- 
tional role models in clinical settings; improved management of patient 
care settings; and improvement in the quantity and quality of patient 
care services. Other research had shown that nurses who obtained 
their college education within a reasonable commuting distance of their 
residence tended to seek or retain employment in that geographical 
area. 

Preliminary plans for the development of a cooperative effort to 
offer off-campus master's degrees were part of the 1975 Advisory Com- 
mittee Report. The report included suggestions for the use of regional 
"learning centers," the augmentation of existing university based grad- 
uate faculty with adjunct "field faculty," proposals for the specific 
research projects that would be pertinent to an off-campus setting, and 
cost components for such programs. 

As a result of the initial work, a grant proposal entitled Expand- 
ing Graduate Nursing Education in Virginia (University of Virginia and 
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Medical Coiicge of Virginia, 1975) was developed. Its purpose was to 
expand significantly the opportunities in graduate nursing education 
beyond the boundaries of the academic campuses of the University of 
Virginia and Virginia Commonwealth University through collaboration 
between the faculties of these two Schools of Nursing. 

That proposal followed the lead of the Report of Needs (SCHEV, 
1975) which had been issued by the State Council of Higher Education, 
and presented additional information on the feasibility of off-campus 
programs. It reported data on available faculty and existing educa- 
tional resources of the colleges and universities in the state which could 
be used in support of off-campus efforts. It also reported statistics on 
existing nursing programs and clinical facilities such as hospitals, 
community health clinics and nursing homes which would provide poten- 
tial sites for student practicum experiences. Also, state-wide library 
resources were canvassed. 

Support of the proposed program was evident in letters from state 
agencies, professional organizations, and educational agencies. The 
State Senate passed a resolution (Senate Joint Resolution H64, 2/9/76) 
commending the cooperative effort and encouraging further development 
of off-campus graduate programs in nursing. 

After documenting the need for additional graduate level education 
programs; demonstrating the feasibility of offo.ring such programs 
off-campus; and enlisting the support of leaders in the health and 
educatiorial communities, specific aims for a cooperative effort were 
outlined by the program planners. They are listed below: 

1. To determine an organizational structure and strategies which 
support joint program offerings. 
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2. To develop a program plan for implementing a joint curriculum 
at the graduate level of nursing education. 

3. To identify and develop the necessary resources for implemen- 
tation of the proposed curriculum including instructional 
strategies appropriate to off-campus instruction. 

4. To select site: for the implementation of the program. 

5. To establish a system to evaluate the effectiveness of the 
proposed curriculum. 

6. To implement the program as planned (p. 20). 

The proposal also summarized planning activities such as deter- 
mining the lines of authority and administrative responsibility; princi- 
ples of operation concerning academic credit, admissions and finance; 
curriculum development and site selection; and the development of an 
instructional committee to recommend appropriate teaching methodologies 
to instructional faculty. 

Faculty recruitment and development plans were also addressed, as 
were sources of long-term funding and a plan for evaluating the pro- 
gram effort. A detailed timetable for implementing the program included 
such items as recruiting a program director, faculty and students, and 
arranging for preliminary course offerings. 

The initial plans to pursue a cooperative project were implemented 
in 1976. A project director was named, and two councils were appoint- 
ed. The Project Advisory Council involved a statewide representation 
of the nursing education community to provide support and to encour- 
age contact from outreach area nurses. The project Executive Council 
was charged with the responsibility of making administrative decisions 
and of setting policy. A joint Curriculum Committee of the two schools 
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of nursing was named to assist with the educational details of the 
proposed Outreach Program including matters of faculty, students and 
course work. 

A detailed curriculum plan was developed which included a tenta- 
tive description of course content and a suggested sequence for a 4-5 
year program. 

Earlier visjts (prior to project funding) to colleges and universities 
in both geographical areas had substantiated the willingness of those 
institutions' administrative representatives to share facilities and re- 
sources for Outreach Program purposes. Following grant approval, 
follow-up visits to these colleges and universities were planned for the 
purpose of specifically defining the space, library services and techno- 
logical equipment and services which could be made available for use by 
fall 1977, and possibly during summer 1977. Initial visits to selected 
hospitals were also planned in Tidewater and Southwest Virginia for the 
purpose of exploring the possibilities of utilizing ^hese clinical resources 
if they were appropriate to the Outreach Program clinical content. 

In November 197S, a visit to the southwestern area of Virginia was 
restricted to the farthermost towns of Bristol, Abingdon, -Big Stone 
Gap, Richlands, Marion, and Wytheville. Discussions with respresenta- 
tives of the four colleges and six major hospitals in these communities 
were informative, positive, and resulted in expressions of full coopera- 
tion and support to Outreac*i Program plans. Also, tentative plans 
were made for subsequent visits to hospitals which appeared to be most 
appropriate as clinical resources. Arrangements were made to visit 
colleges and hospitals in Roanoke, and later, in Radford and Blacks- 
burg. 
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Considerable data regarding educational and clinical resources were 
accumulated and shared with the joint Curriculum Committee and the 
project Executive Council. Additional data on available technological 
resources, potential population of students and evidence of growing 
support for the proposed Outreach Program were also forwarded to the 
project Executive Council. 

These efforts were completed in the first year of the planning 
grant. The goals for the second year were focused on implementing the 
curriculum with its evaluation procedures and plans for long-range 
program expansion. 

By mid-1977, course offerings were implemented at two off-campus 
sites. These courses followed the decisions of the joint Curriculum 
Committee regarding program approval; selection and development of 
educational and clinical resources; recruitment and orientation of fac- 
ulty; and development of program evaluation criteria. By the end of 
the third year of the grant, the project Executive Council reported that 
the major goals of the grant had been achieved. 

Opportunities for nursing education at the master's level had been 
expanded beyond the academic campuses of the University of Virginia 
and Virginia Commonwealth University-Medical College of Virginia. 
Courses were offered in Abingdon, Hampton, Norfolk, Roanoke, and 
Wytheville. An advisory committee of experienced nurses and educators 
was appointed to give faculty level assistance to students in their local 
communities. Courses on alternate Saturdays were made available in 
Richmond. Collaboration took place between the administration and 
faculty of both schools and personnel from both schools worked together 
on committees. 
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In Southwest Virginia in 1977-1978, there were 53 students in the 
process of completing their master^s program. This number represented 
a significant increase in the number of potential master*s prepared 
nurses in the program area. The availability of the program increased 
both the interest of nurses in graduate education and the utilization of 
master's prepared nurses in health care agencies in the state. New 
master's programs were initiated in two universities in the Tidewater 
area and in Northern Virginia during the grant period, leaving only 
Southwest Virginia as the area of continuing need for master's education 
for graduate nurses to be provided through an outreach effort. 

A request for an extension of funding was submitted and ap- 
proved. This extension provided support from July 1, 1979 through 
December 31, 1979, and allowed for course offerings to be maintained 
while the activities of the Initial grant project were completed. By the 
end of the third year of the cooperative project, students in the south- 
western Virginia area had completed one-half of the program of study in 
Medical-Surgical Nursing. 

A second grant proposal entitled Maintaining Graduate Education in 
Southwest Virginia (Johnson, 1979) was funded early in 1980. The 
purposes of this project were to provide assistance in continuing the 
ongoing Outreach Program effort in Southwest Virginia and to plan an 
evaluation of Its effectiveness. The goals of that grant are listed 
below. 

1. General expansion of opportunity for graduate education In 
the program region. 

2. Primary training focus of medical-surgical nursing with sec- 
ondary focus in education, clinical specialty, and administra- 
tion . 
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3. Development of faculty members and additional graduate level 
educated nurses for service in the rural setting. 

4. Providing a positive impact on the overall quality of nursing 
care in the rural area. 

5. Preparation of leaders for the rural nursing community. 

6. Eventual increase in the involvement of graduates in pro- 
fessional and health care related organizations. 

7. Development of additional information in graduate nursing 
education. 

8. Determining the effectiveness of offering graduate nursing 
education as an Outreach Program rather than developing a 
new program on-campus (Johnson, 1979). 

A major segment of the evaluation effort addressed in that grant 
proposal culminates with, and is described in this report. The re- 
mainder of this report describes the details of the evaluation project. 
Its findings and conclusions. 
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SECTION li 
PROGRAM DESCRIPTION 

The following pages include a description of the geography of the 
Outreach Program area and the group of nurses from which the first 
class was selected. Overall course offerings, faculty employed, and 
enrollments are also described. 
Program Setting 

The map on the following page (Figure 1), shows the location of 
teaching sites throughout Southwest Virginia. In addition to the 1979 
Summer Session instruction which was offered at the University of 
Virginia's main campus in Charlottesville, instruction occurred at teach- 
ing sites in Abingdon, Roanoke, Salem, Wytheville and Radford, Vir- 
ginia and Johnson City, Tennessee. 

The Outreach Program enrolled students from a large geographical 
area involving twenty-six counties in Virginia. While the majority of 
students lived in Virginia, several came from upper east Tennessee, two 
were from North Carolina, and one came from Kentucky. During the 
first course offering, when a centrally located site was selected at 
Wytheville, some students had to drive three and one-half to seven 
hours round trip to attend classes. For many students this travel was 
over secondary roads in a mountainous terrain. In addition, weather 
conditions in this part of the state included fog, rain, snow and ice, 
depending upon the season of the year. 

Based on the distances and difficulty of travel for the students, it 
was decided that courses would be offered in more than one site when 
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OUTREACH TEArMlMr. QiTpc 

1 - Charlottesville (UVA) 

2 - Abingdon (Va. Highlands Comm. College) 

3 - Roanoke (Va. Western Comm. College) 

4 - Salem (V. A. Hospital) 

5 - Wytheville (Wythevllle Comm. College) 

6 - Radford (Radford University) 



Figure 1. Outreach Teaching Sites £ 
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possible. Sites were selected in Abingdon and one of three sites sit- 
uated in the more eastern section of this part of the state. 

Faculty members traveled regularly from Charlottesville to the 
various teaching sites during the instructional phase of the Outreach 
Program. In addition, advisory committee members, part-time faculty 
from other institutions and clinical preceptors scattered throughout 
southwestern Virginia and upper eastern Tennessee areas traveled to 
various teaching sites to assist in instruction. The travel time for 
faculty and others involved with the program ranged from two and 
one-half to five and one-half hours one way. The time spent in travel 
meant that time could not be spent in other areas of faculty responsi- 
bility. It also required faculty members to spend the night at the site 
farthest from Charlottesville, thus using two days solely for travel. 

During the initial year of course offerings, 1977-1978, several 
attempts were made for airplane travel to the southwest area, both for 
class sessions and advisory committee meetings. Because of the weather 
and terrain, however, the air travel never materialized. Each flight 
was cancelled either because the plane could not leave Charlottesville or 
could not land at Wytheville. 

During the first year of the grant. Maintaining Graduate Education 
in Southwest Virginia (Johnson, 1979), arrangements were made to have 
a driver for the automobiles taking faculty to the class sites. This 
provided time for the faculty to complete some faculty responsibilities 
during the weekly or bi-weekly two-day trip. 
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Students 

In the Fall of 1977, fifty-three students enrolled in the first 
courses to be offered in the Southwest Virginia area. The courses 
offered were GNUR 730-IVIedical-Surgical Seminar I and GNUR 731- 
Medical-Surgical Practicum I, with each course carrying two semester 
hours of credit. 

While none of the fifty-three students enrolled in the first cours- 
es was formally admitted as graduate students, each was in the process 
of completing the application requirements. Restricting course enroll- 
ment to only those students who were fully admitted would have post- 
poned course offerings until the spring semester of 1978. Therefore, 
the students were enrolled in the first two courses as Special Students, 
thus allowing both an earlier starting date for course offerings and the 
enrollment of a larger number of potential students. The students were 
able to use the experience to weigh the "pros" of graduate study in 
nursing against the "costs" in terms of time, money, energy, job and 
family responsibilities and conflicts. In addition, the students were 
able to demonstrate their ability to meet the expectations for graduate 
study in nursing and could make their own decision, with faculty ad- 
vising, to complete the application for graduate student status or to 
discontinue the application process at that time. 

Prior to the 1979 on-campus summer session, the courses offered 
in the Outreach Program were open for enrollment to Special Students. 
This was consistent wi,th the use of this student category for on-campus 
students as well. The on-campus summer session was restricted to 
those students who had been admitted to graduate student status in the 
Medical-Surgical Nursing major. 
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Course Offerings 

The en-campus graduate medical-surgical nursing program was a 
39-42 credit hour program normally completed in four semesters, with a 
nunimum of two semesters spent in full-time study. The Outreach 
Program was designed so that students could attend school on a part- 
time basis, while maintaining their full-time positions. The courses, 
scheduled to run over a four year period, began in the fall of 1977 and 
ended in the spring of 1981. A full list of Outreach Program courses is 
provided in Figure 2. 
Enrollments 

Enrollment data for the Outreach Program are depicted in Table 1 
by semester and site. Courses were offered weekly or bi-weekly, at 
different sites in Southwest Virginia. These sites included: Abingdon, 
Roanoke, Salem, Wytheville, and Radford. 

The data in Table 2 depict the enrollment in the Outreach Program 
by dividing them into categories of admissions, graduates, and expected 
graduates. The students in the Outreach Program were all enrolled in 
part-time study since they were enrolled in fewer than nine semester 
hour credits per semester. 

The enrollment in the Outreach Program leveled off from 53 stu- 
dents during the first year to 34 students during 1980-1981. This 
decrease reflects attrition due to some students who elected to come 
on-campus for full time study and to other students who dropped out of 
the program because of personal reasons. The most frequent personal 
reason for withdrawing from the program was family responsibilities. 
This included a husband being transferred to another state for employ- 
ment, husband's employment demands, and increased need for financial 
support of college bound children. 
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^ GNUM 73(HiilMicjil-SurglCAl 

NursIrKI S«minar (2) 

* GNUR 73l*ft««J{cal-Surgtc«l 

Nursing Pr«cticum (2) 



1977-1571 

SpHno 

CriUR S10*lntroduction to SUtis* 
tie* (3) 



Summtr 

^ GNUR 860-lntroduction to 
RasMrch (3) 



1S7« - 1979 

« GNUR 775-Hum«o P^ys^olooy 1 (3) » GNUR 77e-Hum^ Physiology II (3) 



^ GNUR 5$2-B«slc Supporting 
ScloncM (2) 

' GNUR S72-Pr(mary Skills in 

Adult HMlth S«n.(2> 



^ GNUR 741-M«Jlc«l-Sijrgic«l Nurs- 
ing PractJcum II (2) 



1979 - 1910 

^ GNUR 740-M«dlc«l-Surgic«l Nurs- 
ing S«minar II (3) 

' GNUR 750-Administrativ* Theory 
* GNUR 701-TMching StratoglM (3) 
^ GNUR 703-Curricula In Nursing (3) 



^ GNUR 8Cl-RosMrch OMlgn (3) 
^ GNUR 896-Pro|«ct Guidance (2) 
^ GNUR 896-Thtsis Guidenco (2) 



» GNUR 701-To«ching Stratogits (3) 

* GNUR 703-CurrioJU In Nursing (3) 

> GNUR 742-Clinl€«| $poc. I (3) 

* GNUR 743-Clinic«l S09c. II (3) 

* GNUR 7S1-Adm<n. strat. in 

Nursing (3) 

> GNUR 89(-Projoct Guidsnco (2) 
» GNUR m-Thwis Guldanco (2) 



1990 - 1991 

GNUR 702-Ssm. & Pr«c. in Tchg <3) 
' GNUR 742-Clinic«l Spoc. I (3) 
' GNUR 743-CIInical Spoc. II (3) 
» GNUR 752-S«m. I. Prac. In Admin. (3) 
^ GNUR 896-Proiact Gutdanca (2) 
^ GNUR <9t-Thtsis Guidance <2) 



^ - Ma|or Coursas 

« - Supporting Courses 

* - Minor (AOnin., Educ, Clinical Spec.) 



Figure 2. Outreach Course Offerings 
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Table 1 



Outreach Graduate Nursing Program Fall 1977-Spring 1981 
Enrollment by Semester and Site 





Course 


Credit 


Enrollment 

A» III W 1 1 1 1 1 \»l 1 %m 


Site 


Fall, 1977 


GNUR 


730 


2 


S3 


Wytheviiie 




GNUR 


731 


2 


S3 


Wytheville 


Spring, 1978 


GNUR 


510 


3 


17 


Roanoke 


GNUR 


510 


3 


18 


Abingdon 


Summer, 1978 


GNUR 


860 


3 


18 


Abingdon 




GNUR 


860 


3 


9 


Roanoke 


Fall, 1978 


GNUR 


775 


3 


29 


Abingdon 


• 


GNUR 


775 


3 


19 


Roanoke 


Spring, 1979 


GNUR 


776 


3 


29 


Abingdon 




GNUR 


776 


3 


19 


Roanoke 


Summer, 1979 


GNUR 


562 


2 


40 


On-Campus 




GNUR 


572 


4 


40 


On-Campus 


Fall, 1979 


GNUR 


741 


2 


2S 


Abingdon 




GNUR 


741 


2 


11 


Roanoke 


Spring, 1980 


GNUR 


740 


3 


13 


Roanoke 


GNUR 


740 


3 


19 


Abingdon 




GNUR 


750 


3 


12 


Abingdon 




GNUR 


701 


3 


6 


Roanoke 




GNUR 


703 


3 


7 


Abingdon 


Summer, 1980 


GNUR 


861 


3 


8 


Roanoke 




GNUR 


861 


3 


18 


Abingdon 




GNUR 


896 


2 


7 


Roanoke 




GNUR 


896 


2 


19 


Abingdon 




GNUR 


898 


2 


1 


Roanoke 


Fall, 1980 


GNUR 


701 


3 . 


9 


Abingdon 




GNUR 


703 


3 


2 


Roanoke 




GNUR 


742 


3 


2 


Roanoke 




GNUR 


743 


3 


1 


Roanoke 




GNUR 


751 


3 


12 


Abingdon 




GNUR 


896 


2 


24 


Rnk/Abdn 




GNUR 


898 


2 


2 


Rnk/Abdn 


Spring, 1981 


GNUR 


702 


3 


9 


Abingdon 


GNUR 


702 


3 


7 


Salem 




GNUR 


742 


3 


1 


Roanoke 




GNl'R 


743 


3 


1 


Abingdon 




GNUR 


752 


3 


11 


Abingdon 




GNUR 


896 


2 


4 


On-Campus 




GNUR 


896 


2 


3 


On-Campus 




GNUR 


896 


2 


6 


On-Campus 




GNUR 


896 


2 


1 


On-Campus 




GNUR 


896 


2 


1 


On-Campus 




GNUR 


898 


2 


1 


On-Campus 




GNUR 


898 


2 


3 


On-Campus 
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Table 2 

Students Enrolled in Outreach Program 



Academic Year 

1977-1978 1978-1979 1979-1980 1980-1981 1981-1982 

Number Enrolled 
Number Graduating 
Expected Graduations 



53 

e 



42 

e 



36 

e 



34 
22 



9 
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The number of projected students graduating from the Outreach 
Program represents a 58% (31 students) completion rate of students 
admiti'id and completing the program. This percent does not reflect 
those students who transferred on-campus and who subsequently com- 
pleted the program. 

As may be seen in Table 3 the initial group of students enrolled in 
the program during the first two years represented a variety of fields 
of employment. Eighty-five percent of the Outreach students were 
employed full time in nursing at the time of their admission to the 
program. 
Faculty Employe d 

Graduate faculty from the University of Virginia School of Nursing 
taught the majority of courses in the Outreach Program. Nursing 
faculty, other than those directly involved in teaching, generally par- 
ticipated in various activities related to the Outreach Program. While 
the involvement may have been limited to telephone contact with the 
students, it could have also included clinical conference presentations in 
the area and/or committee membership on an Outreach student*s thesis 
or project. Where at all possible, support courses were taught by 
qualified faculty from colleges and universities in the Outreach site 
areas. The courses in both the major and minor were taught by grad- 
uate faculty from the School of Nursing. Table 4 presents a complete 
list of the Outreach faculty with respective courses taught and institu- 
tional affiliation at the time of the course offering. Students in the 
Outreach Program came on-campus during the Summer of 1979 to com- 
plete a six credit hour coursework requirement. Typically, Outreach 
students completing their master's degree in Spring of 198T, started 
their program in Fall 1977. r)<, 
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Table 3 

Outreach Students by Field of Employment, 1977-1978 



1977-1978 



Number 
of Students 



Staff Nurse 

Hospital 8 

Community Health Agency 4 

Long Term Care t 

Education Programs 

LPN 1 

Diploma 3 

AON 14 

BSN 5 

Administration 

Hospital 4 

Community Health Agency 1 

Unemployed 5 

Other 7 



Total 53 



Other category included staff development, discharge planning, 
school nurse and/or inservice education positions ♦ 



Field of 
Employment 
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Table 4 

Outreach Faculty by Course Offering and Institutional Affiliation 



Ficulty 


Cours«(s) 


insuUiuonai ATTiiiauon 




GNUR 


741 (2)* 


univsrstvy or Virginia 


Bancroft, BarbM: 


GNUR 


572 


Unlvarsity of Virginia 


Bancroft, Judith: 


wnuit 


702 


Univarsity of Virginia 










BItvInt, R. Daan: 


GNUR 


775 


East Tannassaa Stata Univarsity 




GNUR 


77$ 




Bohannan, Thomas: 


GNUR 


510 


Appalachian Stata Univarsity 


Chtoni, Rom Maria: 


GNUR 


696 


Univarsity of Virginia 


Clort, Elian: 


GNUR 


572 


Univarsity of Virginia 


Crosby, Marian: 


GNUR 


701 (2) 


Univarsity of Virginia 




GNUR 


702 




£rgla, Wilttam: 


GNUR 


510 


Roanoka Collaga 


Fay, Francasca: 


GNUR 


742 


Univarsity of Virginia 




GNUR 


698 




Glait, Carol: 


GNUR 


896 


Univarsity of Virginia 


Gray, Margarat: 


GNUR 


740 (2) 


Univarsity of Virginia 




GNUR 


696 




Hogston, Chadas: 


GNUR 


660 


Virginia Wastam Comm. Collaga 




GNUR 


661 




Johnson, Karan: 


GNUR 


730 


Univarsity of Virginia 




GNUR 


731 






GNUR 


750 






GNUR 


696 (5) 






GNUR 


896 (2) 






GNUR 


742 






GNUR 


743 






GNUR 


751 






GNUR 


752 




Knight, Pat: 


GNUR 


661 


Appalachian Suta Univarsity 


McCoy/ Gana: 


GNUR 


775 


East Tannassaa SUta Univarsity 


GNUR 


776 




Parsons, U. Claira: 


GNUR 


696 


Univarsity of Virginia 


Ropka, Mary: 


GNUR 


742 


Univarsity of Virginia 




GNUR 


743 




RowaJI/ Patricia: 


GNUR 


572 


Univarsity of Virginia 


Shapard, Robart: 


GNUR 


860 


Fast Tannassaa SUU Univarsity 


Taylor, Ann: 


GNUR 


896 


Univarsity of Virginia 


wolf, Wandy: 


GNUR 


562 


Univarsity of Virginia 



*Numb«r of tlmas coursa uught by faculty mambar during Outraach Program. 
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Summary 

The Outreach Program has been described in this section through 
the program setting, the curriculum and the program participants, 
included in the program setting was a description of the Outreach sites 
as well as the geography and travel conditions peculiar to this setting. 
A brief description of the Outraach curriculum and Outreach faculty 
was presented in this section as well as enrollment and other descrip- 
tive data related to the students involved. 
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SECTION III 
EVALUATION APPROACH 

Although evaluation has become an accepted part of educational 
planning and program implementation, it is, nevertheless, important to 
focus on the general purposes for conducting an evaluation and on the 
approach used in the evaluation of the University of Virginia Outreach 
Program. This section does not include evaluation methodology since it 
is included in each section of the various components of the program 
evaluation. The purpose of this section is to describe the approach 
and structure of evaluating the Outreach Program. 
Purposes for Evaluation 

In general evaluations are done to determine the effectiveness of 
programs/ that is, to make judgements about whether the program 
objectives have been met (Dressel, 1976). Also, evaluation results 
become available as part of the literature and provide direction for 
other programs with similar goals. 

This general goal, to measure effectiveness, was one focus of the 
Outreach Program. Particular expectations had been spelled out by 
those who contributed to the initial plans for off-campus program imple- 
mentation / and the question as to whether those expectations had been 
met needed to be addressed. 

Another purpose for conducting an evaluation is to determine 
whether program plans which spell out a series of objectives (intended 
outcomes, anticipated results) are consistent with the actual results 
observed after proL, am completion. Evaluations that concentrate on 
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comparing pre-program expectations with post-program outcomes rely on 
a discrepancy approach (Provus, 1971). 

A third issue that points to the need for evaluation is the notion 
of accountability. Have the resources expended on the project been 
put to good use? Can the costs of the program be justified? Does the 
budget represent an efficient use of financial resources? Such ques- 
tions can be addressed in an evaluation plan that focuses on a cost- 
benefit measure of efficiency (Scriven, 1974). Cost/benefit studies lead 
to decisions whether particular programs are self-supporting or cost 
effective enough to justify their continuance. For the Outreach Pro- 
gram it was necessary to determine whether the resources expended 
represented a cost greater or lesser than other programs spent to 
achieve simifar objectives. 

A fourth consideration for this evaluation effort concerned the 
unique types of benefits which were expected to result from off-campus 
instruction. Because of the innovative nature of this program, little 
comparison data on the positive outcomes of similar programs were 
available. Therefore, particular attention was paid to collecting infor- 
mation from ail groups who had been involved in the program with the 
aim of describing comprehensively the positive outcomes of the program. 

The broad outlines of the program evaluation encompassed the 
outcomes that had been anticipated in program planning documents; the 
positive goals or products of the program (as contrasted with the 
results of a process evaluation); and the overall efficiency of program 
implementation, with particular attention to the unique costs generated 
in off -campus evaluation. 



Evaluation Approach 

In developing a frame of reference from which to structure the 
process of evaluating the Outreach Program (see Figure 3), project 
staff undertook a review of the literature in higher education, evalua- 
tion, and graduate nursing. The focus of this literature review was 
based on the results of an analysis of the purposes, goals and objec- 
tives of both the original and the maintenance grants by the Project 
Director and Evaluation Consultant. This review yielded information 
which was included in several position papers describing the ''state of 
the art" in the evaluation of off-campus programs similar to the Out- 
reach Program. After the literature reviews, a decision was made to 
assess the program by approaching the evaluation issues of effective- 
ness, costs, benefits, negative outcomes and overall program account- 
ability. 

The planning documents and grant proposals upon which the 
Outreach Program was based were again reviewed. Program objectives 
and anticipated outcomes were listed as focal points for the evaluation 
design. The study of costs and benefits was structured around the 
actual expectations of program planners and administrators in combi- 
nation with the general expectations which the literature review had 
suggested for similar programs, while the study of negative outcomes 
followed the collection of data from program participants. 

For the purposes of the evaluation, effectiveness, costs, benefits, 
negative outcomes, and overall program accountability were defined as 
follows: 

Effectiveness : The degree to which program goals and expecta- 
tions have been met. 



EVALUATION APPROACH 



ANALYZE GRANT PROPOSAL TO DETERMINE PROGRAM OBJECTIVES 

I 

REVIEW LITERATURE 

I 

DESIGN EVALUATION STUDY 
(Effectiveness, Costs, Benefits, Negative 
Outcomes, Overall Accountability) 

) 

IDENTIFY DATA NEEDS AND SOURCES 

I 

DEVELOP GUIDELINES AND INSTRUMENTS 

I 

COLLECT DATA 

I 

ANALYZE DATA 

i 

CONCLUSIONS AND JUDGEMENTS ABOUT THE PROGRAM 

ASSESS LONG-TERM IMPACTS 



Figure 3. Evaluation Approach 
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Costs : The amount of resources expended in support of the 
educational program activity. 

Benefits : The positive results or outcomes which can be antici- 
pated from participation in or exposure to an educational 
program. 

• Negative outcomes : The negative results or outcomes which can be 
anticipated from the participation in an educational program. 
These may include personal losses or sacrifices of opportuni- 
ties to gain resources. 
Program accountability : An overall judgment which considers 
attainment of program goals and objectives In relation to 
costs, benefits, and negative outcomes. In essence, was the 
value of the program to individuals, groups and institutions 
worth the expenditure of fiscal and human resources. 

Summary 

The design of the evaluation project was summarized in Figure 3. 
The evaluation approach Included an analysis of the grant proposal to 
locate program objectives; a review of selected literature in the area of 
higher education, graduate programs and off-campus instruction in 
nursing; and an evaluation design with definitions of data elements. 
The routine steps of identifying data needs and sources, designing data 
collection instruments and collecting and analyzing the data were plan- 
ned to precede conclusions about the program future and judgements 
about its impact. An assessment of long term program impacts was also 
included. Details on formulation of cost data, results of surveys and 
Interviews, and conclusions about program outcomes are described in 
the remainder of this report. 
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SECTION IV 
EFFECTIVENESS 

As defined in Section III, effectiveness describes the degree to 
which program goals and expectations have been met. 

The eight major objectives listed as part of the grant proposal 
which described the University of Virginia Outreach Program ("Main- 
taining Graduate Education In Southwest Virginia") are repeated below, 
along with the methodology used in the assessment of the degree to 
which they have been met. 
Major Objectives 

OBJECTIVE #1: General Expansion of Opportunity for Graduate Edu- 
cation in the Program Region 

In order to determine whether this objective had been met, data 
from the initial feasibility study were used to describe the educational 
opportunity available to those nurses in Southwest Virginia desiring a 
master's degree prior to the implementation of ths Outreach Program. 
Additionally, students and community members Involved In the Outreach 
Program were surveyed and Interviewed by the evaluation team In 
reference to the program objectives. Finally, enrollment data were used 
in assessing this objective. 

Before the Outreach Program came to Southwest Virginia, pros- 
pective master's degree students had traveled to Richmond or Charlot- 
tesville to attend full-time programs, or out of state to Tennessee or 
North Carolina. Nurses who wished to attend graduate school on a 
part-time basis while maintaining their jobs In Southwest Virginia had 
no such option. 
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It was the unanimous conclusion of those who completed the pro- 
gram that both the location of the program and its structure (in terms 
of scheduling) had allowed them an opportunity not otherwise possible 
to expand their education. This conclusion was echoed by members of 
the program advisory committee and supports the contention that the 
establishment of the University of Virginia Outreach Program was suc- 
cessful in providing an opportunity for graduate education in Southwest 
Virginia, Over fifty nurses took advantage of the program, and more 
than thirty of them completed a degree. 

OBJECTIVE #2: Primary Training Focus of Medical-Surgical Nursing 

with Secondary Focus in Education, Clinical Special- 
ties and Administration 

The assessment of this objective was accomplished through the 
collection of data on course offerings and clinical experiences. The 
curriculum was reviewed in order to determine the training focus. 

Outreach course offerings and the curricular direction of the 
entire program were structured around Objective .#2. In the 1977-78 
program year, two seminars were offered in medical-surgical nursing. 
Students were able to enroll in the course "Primary Skills in Adult 
Health" in the second year of the program (1978-79). Two advanced 
courses on topics in medical-surgical nursing were available in the third 
program year (1980-81) to complete the major field of emphasis. 

Courses in the theory and strategies of administration were offered 
in the final two years of the program, as was a seminar and practicum 
experience in nursing administration. For the education minor, courses 
were offered in teaching strategies and curriculum, and a practicum 
experience was scheduled for education minors in the final year of the 
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program. Courses in clinical specialties were available during the fall 
and spring semesters of the 1980-81 academic year. 

All students completed the program with a major in Medical-Surgical 
nursing, and students were graduated in each of the three minor areas 
of administration, education and clinical specialty. 
OBJECTIVE #3: Development of Faculty Members and Additional 

Graduate Level Educated Nurses for Service in the 
Rural Setting 

Data cn Outreach students employment during and after their 
involvement in the Outreach Program were analyzed to assess the achieve- 
ment of the third objective. 

Since almost all of the nurses enrolled in the Outreach Program 
maintained their jobs while they were students and remained in the 
program area after program completion, the third objective was a nat- 
ural outgrowth of the program's existence. Those who were faculty 
members before the Outreach Program remained as teachers, putting 
their advanced education to use as each learning experience occurred. 
The master's decjree qualified them to teach in existir baccalaureate 
and associate degree programs in the area, as well as making the estab- 
lishment of new programs a more feasible alternative in the future. 
Hospital nurses and administrators became qualified, as a result of the 
program, for higher level positions in the communities where they 
worked , 

OBJECTIVE #4: Providing a Positive Impact on the Overall q uality 

of Nursing Care in the Rural Area 
This objective speaks to one of the more difficult issues for pro- 
gram evaluation, i,e,, assessing the long-term results of an educational 
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program. In the short run it is possible to conclude that the existence 
of the Outreach Program and the graduate level nurses it produced will 
provide a nucleus of talent to raise the quality of nursing care in 
Southwest Virginia. However, more specific measures of increases in 
"quality of care" must await the passage of time when particular long 
term results of the educational program can be measured. 
OBJECTIVE #5: Preparation of Leaders for the Rural Nursing 

Community 

Since the prt ^ ram has been completed only recently, it is pre- 
mature to address the leadership roles which may be taken by nurses 
who had the experience of the Outreach Program. Like Objective #4, 
this objective should be assessed from more of a long-term perspective. 

OBJECTIVE #6: Eventual Increase in the Involvement of Graduates 

in Professional and Health Care Related Organizations 

This objective, like the previous two, must await long term assess- 
ment. Limited evidence is available, however, that Outreach students 
have begun to become involved in nursing organizations as a result of 
their educational experience. A further assessment of this trend must 
occur In the future, since some nurses also reported having to decrease 
their involvement in professional organizations as a result of the busy 
schedule of school and work. Recovery of this prior involvement may 
be a confounding issue in attributing involvement to the educational 
program. 

OBJECTIVE #7: Development of Additional Information in Graduate 

Nursing Education 
This objective pertains 3Tiost clearly to the knowledge to be gained 
by the faculty of the University of Virginia School of Nursing about 
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improved techniques and strategies for conducting programs off -campus. 
Faculty members were interviewed to determine whether teaching tech- 
niques or currlcular materials for the Outreach Program would be a^'ail- 
able or helpful to the on-campus program. The report of the faculty 
indicates that not only did the program provide a practical "proving 
ground" for theories about off -campus instruction, but also, that it 
provided an arena to test teaching arrangements yet to be tried In the 
on-campus curriculum. In addition, the knowledge gained in the Out- 
reach Program Is already being disseminated to nursing educators 
nationally both through conference presentations and in formal publica- 
tions. 

OBJECTIVE #8: Determining the Effectiveness of Offering Graduate 

Nu*-sing Education as an Outreach Program Rather 
than Developing a New Program On-Campus 
As data on earlier objectives made clear, the expansion of oppor- 
tunity for graduate nursing education in Southwest Virginia and the 
resulting higher level of nursing skills in the area could not have been 
realized by providing a new program on-campus in Charlottesville. 
Whether full or part-time, such a program would have been geograph- 
ically removed from those students who needed it most. The Outreach 
Program made possible what on-campus programs could not: an oppor- 
tunity for graduate education for working nurses in an area remote 
from the main university setting. 
Summary 

As the first graduates of the program completed their studies, five 
objectives (i.e. numbers 1, 2, 3, 7, 8) have been met. Three other 
objectives (i.e. numbers 4, 5, 6) are concerned with the long-term 
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impact of program involvement upon students and the health care sys- 
tem in which they work a*^ nurses* A "Long-Term Impact Survey" 
(Appendix D) will be distributed in Spring 1982 to assess then. The 
list below separates the program objectives into those which have been 
met and those yet to be met. 
Program Objectives 

A. Have Been Met : 

1 . General expansion of opportunity for graduate 
education in nursing in the program region • 

2. Primary training focus of medical-surgical nursing 
with secondary focus in education, clinical spec- 
ialties, and administration. 

3. Development of faculty members and additional 
graduate level educated nurses for service in the 

" rural setting. 

7. Development of additional information in graduate 
nursing education. 

8. Determining the effectiveness of offering graduate 
nursing education as an Outreach program. 

B. To Be Met : 

4. Providing a positive impact on the overall quality of 
nursing care in the rural area. 

5. Preparation of leaders for the rural nursing com- 
munity. 

6. Eventual increase in the involvement of graduates in 
professional and health care related organizations. 
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SECTION V 
COST OF OUTREACH PROGRAM 

This section of the Evaluation Report includes detailed descriptions 
of the guidelines used to determine direct instructional costs of the 
off-campus program. The purpose of this section is to apply these 
guidelines to actual cost data which will yield figures such as direct 
Instructional unit costs using student credit hours, and average aca- 
demic degree program costs for a student; including direct instructional 
costs of major, minor, and supporting courses. 

Caution should be exercised in interpreting the cost figures of this 
program with any other cost figures, as costing definitions, methodolo- 
gies, and applications may differ significantly. Identifiable expendi- 
tures for maintaining an off-campus program are necessarily exclusive 
of many Indirect costs which would be included in determining the total 
instructional expense of an on -campus program. For example, cooper- 
ation from schools and agencies in Southwest Virginia has allowed the 
program to exist at a price not likely to be duplicated in other off- 
campus programs. 

Using Cost Information: Selected Literature 

The cost analysis, as described in this section of the report, will 
be used as a measure of program efficiency as well as yielding other 
useful conclusions regarding the Outreach Program. A brief review of 
the literature on cost arjalyses suggests varied uses for cost data. 

As defined by the State Council of Higher Education for Virginia 
(1981), "Cost analysis measures the current costs of various units of 
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existing activities" (p. 1). Internally; cost analysis can be used as a 
planning and management tool which enhances decision making. Know- 
ledge of present cost makes available descriptive data about an institu- 
tion's allocation and consumption of resources. By using cost data, 
decision makers can assess the implications of educational alternatives. 
Management can monitor cost information and, if necessary, alter re- 
source allocations to reflect the expansion or reduction of academic 
programs. Cost information helps institutions make comparisons with 
cooperating institutions. As a basis for external funding, cost data are 
used to determine funding support levels and to justify budget re- 
quests. Cost data related to efficiency, effectiveness, or productivity 
are used to promote accountability in higher education (Hample, 1980). 

Cost analysis can also facilitate more accurate estimates of future 
resource levels. According to Balderston (1974), cost analysis is useful 
for: 

1 . Operating and management; 

2. Providing critical inputs for planning major changes in capa- 
city, program structure, or institution policies; 

3. Obtaining comparisons Lietween institutions, to help us share 
insights about what targets to set; 

4. Justifying to funding sources (public and private) what 
prices we charge for educational and institutional services and 
what resources are needed; (p. 141) 

and should answer the following questions in order to provide tr.eaning- 
ful information to the decision makers: 

1. What resources are being absorbed? 

2. How does resource use vary with changes in the volume of 
activity? 



41 

3. Is the pattern of resource use efficient? 

4. What is the trend over time? (p. 147) 

Due to the limitations involved in measuring educational outcomes, 
cost studies are generally limited to the study of functions where there 
is a known unit of measure. The problems and issues surrounding the 
process of cost analysis are varied, but appear to center around the 
issues of: 1) a lack of standardization of items and the consequent 
difficulty in measuring these terms, and 2) the inability of the organi- 
zation to provide useful cost information to the user (decision maker). 
Because of the present limitations of many cost analysis techniques, 
much cost data cannot be used for inter-institutional comparability of 
costs. 

The development of useful cost analysis techniques is necessary 
because of the demands placed on higher education for accountability, 
quality decision making, and increased competition for limited resources. 
Unfortunately, recent developments in cost analysis using "universal 
procedures" have proven to be limited in their usefulness. As the 
Change Panel on Academic Economics (1976) states, "We [higher edu- 
cation] are on the way to knowing the cost of everything and the value 
of nothing" (p. 39). Cherrington (1979) suggests that the concept of 
cost analysis in the academic world must combine the 'numbers' with an 
understanding of the goals and objectives of the institution. To ac- 
complish this difficult task, the cost analysis technique needs to be 
matched both to the administrator's question and to the decision which 
is being made. A general framework of cost analysis may be useful, 
provided it has the necessary flexibility to adapt itself to the particu- 
lars of a situation. 
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Definition of Cost Terms 



In order to have a clear understanding of the cost findings, it is 
important to first establish the definitions of terms used in this costing 
approach. 

As indicated previously, the cost analysis was expected to yield 
data on unit costs and to approximate the costs of operating an off- 
campus graduate nursing program, thereby providing essential infor- 
mation regarding the feasibility of continuing such a program. In 
accordance with these expectations, appropriate guidelines were devel- 
oped for use in the cost study. These guidelines arc reflected in the 
costing terminology presented in the following section. 

Costs . There are a variety of terms used in cost studies to 
describe costs. Illustrating the numerous modifiers for the term "cost" 
Nlatz, Curry and Frank (1962) indicate that: 

An analysis ... reveals that there are many types of 
cost. The historical meaning of the term "cost" is modi- 
fied by such descriptions as direct, prime, indirect, 
fixed, variable, controllable, product, joint, estimated, 
standard, future, r-^^placement, opportunity, inputed, 
sunk, differential, and out-of-pocket. Each modification 
implies a certain attribute which is important not only to 
the cost accountant who uses the concept, but also, to 
business management to whom these costs must convey a 
specific meaning and message. An abstract definition of 
cost is not sufficient for an understanding of the term. 
A cost must be understood in its relationships to the 
purpose or purposes for which it is to serve, (p. 22) 
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For purposes of their study, Ziemer, Young, and Topping (1979) 
define costs as "the measure in dollars of institutional resources used in 
the process of providing institutional outputs during a given time 
period" (p. 10). The definition of cost employed in the analysis of the 
University of Virginia's Outreach Program conforms closely to this 
definition. 

Opportunity costs. An opportunity cost refers to the opportuni- 
ties lost whenever a decision is made to expend resources. These lost 
opportunities are sacrifices made by reason of the decision. As men- 
tioned by Bowen (1980), the monetary costs of higher education may 
not account for the opportunity costs of the resources employed. Also 
referred to as real costs, the opportunity costs may be monetary or 
non-monetary. For example, in the Outreach Program opportunity costs 
are used in the cost section to refer to faculty time lost due to travel 
to the Outreach sites. Although monetary costs will be used in this 
study, an awareness of other measures of cost is beneficial. 

Direct costs. The American Council on Education (1965) defines 
direct costs as costs "readily assignable to a specific cost objective as 
an ordinary part of its operation" (p. 4). Hample (1980) defines direct 
costs as those costs having an "obvious direct relationship to the in- 
structional product and which can be defined as those costs which 
would oe directly and immediately affected by enrollment changes" 
(p. 2). The direct cost of an activity is the total sum of resources 
which are directly consumed by the activity ( Change , 1976). 
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As mentioned previously; the activity (or cost objective) being 
studied is off -campus nursing instruction. Direct instructional costs 
will be determined using ACE's definition of direct costs as "costs read- 
ily assignable to a specific cost objective as an ordinary part of its 
operation," Instructional salaries, secretarial support, student support 
services, other contractual services, supplies and equipment will be 
included as direct instructional costs of the off-campus program. In 
addition, travel expenses incurred for instructional activities in the 
off-campus program will be considered to be a direct cost, due to their 
direct relationship to the activity. 

Instructional costs . Instructional costs are direct costs that 
describe the amount of resources expended for non-research, non- 
public service activities. They are the costs incurred helping students 
meet "specified formal curricular requirements, leading to a particular 
degree or certificate granted by the institution" (Ziemer, Young and 
Topping, 1971, p. 27). In the Outreach Program, instruction is 
offered via courses which include clinical experiences. The Institute of 
Medicine (1972) established that clinical costs be included in instruction 
for schools of nursing where clinical teaching is conducted in facilities 
established primarily for teaching purposes. Since clinical experiences 
for off-campus nursing students take place in a variety of settings, 
clinical costs will be limited to the cost of the clinical preceptor. 
Turning instructional costs into meaningful information requires that the 
costs of instruction be related to the number of units of service ren- 
dered. (Bowen, 1980). 
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Unit costs. A unit cost is a "quantified value of the resources 
invested and expended, divided by a standard measure of outcome such 
as contact period, credit, major program, curriculum, or student" (Wit- 
mer, 1972, p. 99). Sometimes referred to as average costs, they are 
"the total cost attributed to a cost center divided by the total number 
of units of output produced by that cost center" (Ziemer, 1971, p. 
285). The direct instructional unit costs for the Outreach Nursing 
Program will be related to student credit hours and the academic degree 
program requirements. 

Enrollment. The National Center for Higher Education Management 
Systems (1978-79) defines enrollment as "the duplicated number of 
students enrolled in courses as of an official census date, by unit/ 
department of instruction or by student programs" (Sherrill, p. 79). 
Student credit hours . Student Credit Hours constitute: 

A unit of measure that represents one student engaged 
in an activity for which one hour of credit toward a 
degree or other certificate is granted upon successful 
completion. Total student-credit hours for a course are 
calculated by multiplying the course's credit-hour value 
by the number of students enrolled in the course. 
(Sherrill, p. 80). 
Degree program . The State Council of Higher Education for Vir- 
ginia (1979) defines a degree program as a "logical combination of 
courses with concentration in a single or several discipline areas" 
(p. 23). In this report, a degree program refers to the 39-42 credit 
hour off-campus graduate nursing program. There are four components 
to the Outreach Program: major courses, supporting courses, minor 
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courses, and eiectives. Since elective courses were not offered through 
the Outreach Program, this component will not be considered. The 
major consists of 13 credit hours of coursework; the supporting area 
requires 18 credit hours; and the minor area is 6-9 credit hours de- 
pending on the choice of specialization; i.e. administration (9), edu- 
cation C9), clinical specialization (6). 

Faculty salary and workload . As faculty salaries comprise a major 
portion of direct instructional costs, the appropriate distribution of 
faculty costs to the program is accomplished through an analysis of 
facutty workloads. As SCHEV (1979) reports there are several methods 
used in the distribution of faculty costs; some using the time expended 
in an activity and others based upon effort involved in the activity. 
For instructional faculty, with the exception of the Program Director, 
costs were distributed using designated efforts (% of time allocated to 
off-campus instruction) as reported in the faculty workload grant 
reports. Due to the nature of the Program Director's involvement in 
the program, a percentage breakdown of effort for the distribution of 
costs was developed reflecting the varied responsibilities of the posi- 
tion. The breakdown allowed for variations in cost distributions to the 
program based on assigned teaching responsibilities each semester. 

Cost objectives (program classification structure) . In order to 
begin a cost study, an appropriate cost objective needs to be defined. 
The National Association of College and University Business Officers 
(NACUBO) describe a cost objective as a "defined entity to which cost 
is related, ... and can be an organizational unit, a project, responsi- 
bility center, function, program, or some other identifiable entity" 
(SCHEV, 1979). The Virginia Program Classification Structure (PCS) 
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details such a taxonomy of cost objectives. The PCS is presented in 
Figure 4. As reported by SCHEV (1979), the PCS provides a standard 
procedure to assign information regarding institutional resources and 
activities. In this study, the PCS will be used to record actual direct 
instructional expenditures for the Outreach Program. In order to 
determine a direct instructional cost, expenditures will be assigned 
under the categories of (1.0) Instruction and (4.0) Academic Support. 

Guidelines. As used in this study, guidelines refer to the pro- 
cedures or methodology used to derive the direct instructional costs of 
the Outreach Program. A guideline suggests a flexibility in method- 
ology as opposed to the exactness of a formula. 
Methodology 

In order to develop meaningful cost information, the calculation of 
direct instructional costs for the Outreach Program followed the guide- 
lines formulated in the Program Classification Structure (PCS). The 
structure of cost objectives, as defined by PCS, became the framework 
to which expenditures ($) were attached. Average direct instructional 
costs were computed for the outputs of student credit hours, courses in 
program major, minor and supporting areas and per graduate. Unit 
costs were developed by quantifying these outputs for each cost objec- 
tive. 

Enrollment and cost data were collected from monthly financial 
reports at the University of Virginia and Virginia Commonwealth Uni- 
versity-Medical College of Virginia Schools of Nursing's fiscal offices, 
the University of Virginia's Division of Continuing Education and its 
Office of Sponsored Programs. 
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Data on enrollment were used along with the credit hours of 
courses offered in the program to produce student credit hours, a 
commonly used measure of instructional output. Table 5 provides 
enrollment information for the off-campus program, depicting the 
sequence of courses, course credit, course enrollment, instructor's 
name, course location and student credit hours. The data in Table 5 
are used in the determination of direct instructional costs. 

The direct costs of instruction consisted of specific costs related 
to this program. These costs were assigned to the PCS categories of 
(1.0) Instruction and (4.0) Academic Support. Direct instructional 
costs for the off-campus program included: salaries for faculty and 
other instructional personnel, travel expenses for all instructional 
personnel, and expenditures for academic support. 

Teaching faculty referred to those faculty members recorded as 
having teaching responsibility for off-campus courses; both University 
of Virginia and part-time Outreach faculty. Other instructional person- 
nel referred to those providing direct instructional support or assistance 
including: clinical preceptors, teaching assistants, academic consultants 
(personnel providing specialized knowledge and assistance to faculty 
and students), guest lecturers, faculty providing thesis and/or project 
guidance, and others identified as being engaged in direct instructional 
activities. Travel expenses (mileage, food and lodging) related to the 
necessary transportation of instructional personnel to the instructional 
sites were calculated separately in order to illustrate one of the unique 
costs of the Outreach Program. 

Instructional faculty from the University of Virginia providing 
their teaching services at no charge (NC) to the grant are noted as 

P J 
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Table 5 

Outreach Graduate Nursing Program Fall 1977-Spring 1981 
Student Credit Hours by Course and Semester 



Student 



Semester 


Course 


Credit 


Enrollment 


Site 


Instructor Credit Hours 


Fall, 1977 


r^Ki 1 1 D 
VaN U K 


/oU 


2 


53 


Wytheville 


Johnson 


inA 




OKI 1 1 D 

VjN U K 


/o 1 


2 


53 


Wytheville 


Johnson 


infi 


Spring, 1978 


Kl 1 1 D 

VjN U H 


o lU 


3 


17 


Roanoke 


Ergle 


9 1 


/^Kl 1 1 D 

VjN u K 


D lU 


3 


18 


Abingdon 


oonannan 




Summer, 1978 


OKI 1 1 D 


oou 


3 


18 


Abingdon 


oneparu 


o*t 




O Kl 1 1 D 


OOU 


3 


9 


Roanoke 


nousion 


on 

CI 


Fall, 1978 


OKI 1 1 D 


/ /o 


3 


29 


Abingdon 


Dievins 


o/ 




O Kl 1 1 D 


/ /D 


3 


19 


Roanoke 


ivjc^oy 


«;7 


Spring, 1979 


OKI 1 1 D 


/ /O 


3 


29 


Abingdon 


Dievins 


ft7 
o/ 




OKI 1 1 D 

(jN U K 


/ /O 


3 


19 


Roanoke 


mc^oy 


3/ 


Summer, 1979 


OKI 1 1 D 




2 


40 


On-Campus 


wol r 


AO 




OKI 1 1 D 


Did 


4 


40 


On-Campus 


o. DancruiL, 

Olr^r*A P t^\t.tf\. \ 1 

^lure, Koweii 


IfiO 


Fall, 1979 


OKI 1 1 D 


/*t 1 


2 


25 


Abingdon 


Mnaerson 


^0 




O Kl 1 1 D 




2 


11 


Roanoke 


Mnaerson 




Spring, 1980 


OKI 1 1 D 


/*tU 


3 


13 


Roanoke 


Vjiay 






OKI 1 1 D 


/**u 


3 


19 


Abingdon 


V3 1 a y 


3 / 






/ ou 


3 


12 


Abingdon 


In h n ^nn 


36 




OKJ 1 1 D 


701 
/U 1 


3 


6 


Roanoke 


^ 1 UdUy 


18 




OKJ 1 1 D 




3 


7 


Abingdon 


1 R a n r» n "t" 
O • Dal iCi U 1 L 


21 


Summer, 1980 


rXhl 1 1 D 
VjIN U f\ 


GO 1 




8 


Roanoke 


n U LI O LUI 1 


24 




OKI 1 1 P 


CO 1 


3 


18 


Abingdon 


r\i 1 1 u f 1 L 






OM 1 1 P 


ovo 


2 


7 


Roanoke 


OUI 1 1 loUl 1 


14 




OM 1 1 P 




2 


19 


Abingdon 


In h n^nn 


38 




OM 1 1 P 




2 


1 


Roanoke 


1*^ h ncnn 


2 


Fall, 1980 




701 

/ U 1 


3 


9 


Abingdon 


1 \J O LJ y 


27 








3 


2 


Roanoke 


1 Rsnppn'ft" 


6 








3 


2 


Roanoke 


dy 


6 




GNUR 


743 


3 


1 


Roanoke 


Johnson 


3 




GNUR 


751 


3 


12 


Abingdon 


Johnson 


36 




GNUR 


896 


2 


24 


Rnk/Abdn 


Johnson 


48 




GNUR 


898 


2 


2 


Rnk/Abdn 


Johnson 


4 


Spring, 1981 


GNUR 


702 


3 


9 


Abingdon 


Crosby 


27 


GNUR 


702 


3 


7 


Salem 


J. Bancroft 


21 




GNUR 


742 


3 


1 


Roanoke 


Ropka 


3 




GNUR 


743 


3 


1 


Abingdon 


Ropka 


3 




GNUR 


752 


3 


11 


Abingdon 


Johnson 


33 




GNUR 


896 


2 


4 


On-Campus 


Gleit 


8 




GNUR 


896 


2 


3 


On-Campus 


Gray 


6 




GNUR 


896 


2 


6 


On-Campus 


Johnson 


12 




GNUR 


898 


2 


1 


On-Campus 


Parsons 


2 




GNUR 


896 


2 


1 


On-Campus 


Taylor 


2 




GNUR 


898 


2 


1 


On-Campus 


Chioni 


2 




GNUR 


898 


2 


3 


On Campus 


Fay 


6 
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such in Table 6. Salaries for these NC faculty members were based on 
the faculty member's actual salary during the semester of the course 
offering multiplied by the time effort (%) allocated to the grant. In 
order to compute a realistic cost for the direct instruction, these in- 
kind (NO costs have beer, included. Where in-kind salaries were 
calculated, as in the Fall 1979 semester, the in-kind portion of the total 
instructional salary was indicated as a point of reference. 

As discussed earlier, in order to include an accurate assessment of 
the Program Director's direct instructional salary, a proportion of her 
salary, specifically that proportion relating to instruction was assigned 
to the category of Instruction, while the rest was assigned to Academic 
Support. To designate this amount, an appropriate weighting guideline 
(Figure 5) was used. 

The guidelines for the determination of the direct instructional cost 
per stude nt credit hour are outlined in Figure 6. These guidelines 
were used on a semester basis "hereby the total expenditures for 
instructional salaries, travel costs and academic support were added 
together and then divided by the respective student credit hours. The 
totals for instructional salaries, travel costs, and academic support for 
each semester were then added together to produce a total direct in- 
structional cost and were then divided by the total number of credit 
hours to produce an average direct instructional cost per student credit 
hour for the program. 

Using the guidelines outlined in Figure 7, an approximate direct 
instructional cost of offering the off-campus program to one student was 
calculated. in the process of deriving average program costs, the 
average costs for courses in program major, minor and supporting area 
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SALARIES 
& TRAVEL 
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SEMESTER/ STUDENT 
COURSF. CREDIT HOURS 


INSTRIIfT'l 
OML.Mt\i CO 


TO AX/PI 

CUb 1 b 


ACADEMIC 
bUPPORT 


COST5 
ACAUcMIC 
SUPPORT 


COST PER 
STUDENT 
CREDIT HOUR 


Fall, 1977 














GNUR 730 


106 


$ 5,973.53 


$ 1,370.29 


$ 4,632.10 


$ 11,975.92 


$ 56.50 


GNUR 731 


106 








Spring, 1978 














GNUR 510R 


51 


8,287.94 


1,469.79 


1 1,443. 


21,201.39 


201.92 


GNUR 51 OA 


54 










Summer, 1978 














GNUR 860 


81 


3,000.00 


- 


9,684.14 


12,684.14 


156.59 


Fall, 1978 










GNUR 775 


114 


4,500.00 


620.67 


15,398.05 


20,518.72 


142.49 


Spring, 1979 










GNUR 776 


144 


4,884.44 


75.46 


13,627.10 


18,587.00 


129.08 


Summer, 1979 










GNUR 562 


80 


10,249.78 




12,753.64 


23,003.42 


95.85 


GNUR 572 


160 








Fall, 1979 














GNUR 741 


72 


6,883.69 


550.05 


16,746.25 


24,179.99 


335.83 






(3,250.00=NC*) 








Spring, 1980 














GNUR 740 


96 


8,994.71 


4,332.98 


8,395.13 


21,722.82 


127.03 


GNUR 750 


36 


(8,185.00=NC) 






GNUR 701 


18 










GNUR 703 


21 












Summer, 1980 














GNUR 861 


78 


4,987.50 


663.01 


4,630.51 


10,281.02 


77.89 


GNUR 896 


52 








GNUR 898 


2 
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Table 6 (Continued) 



SEMESTER/ 
COURSE 



STUDENT 
CREDIT HOURS 



INSTRUCT'L 
SALARIES 



TRAVEL ACADEMIC 
COSTS SUPPORT 



SALARIES 
& TRAVEL 

COSTS 
ACADEMIC 

SUPPORT 



COST PER 
STUDENT 
CREDIT HOUR 



rail/ i^ou 




olNU K /u 1 


di 


oINUK /{Jo 


/> 
D 


riKii i O '7 AO 


o 


orMun i ou 


o 


orMU K /D 1 


ob 


GNUR 896 


48 


GNUR 898 


4 


Spring, 1981 




GNUR ■'02 


27 


GNUR 702 


21 


GNUR 742 


3 


GNUR 743 


3 


GNUR 752 


33 


GNUR 896 


8 


GNUR 896 


6 


GNUR 896 


12 


GNUR 896 


2 


GNUR 896 


2 


GNUR 898 


2 


GNUR 898 


6 



12,068.33 
(8,173.33=NC) 



5,503.66 10,035.52 



27,607.51 



217.38 



11,051.39 
(8,993.33=NC) 



4,276.38 



5,955.30 



21,283.07 



170.26 



TOTAL 



1,553 



80,881.31 



18,862.29 113,301.40 213,045:00 137.18** 
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* NC= No Charge Faculty (Salary = Gross Salary x Time Effort) 
** Average Direct Instructional Cost per Student Credit Hour 
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Semesters Involved in Direct Instruction 

Direct Instruction (1 class) 25% 

Advising (Student) 15 

Academic Administration 10 

Total Time Effort to Grant Project 50% 

All Other Semesters 

Instructional Planning and Advising 20% 

Unscheduled (Informal) Teaching 

Responsibilities 5 

Advising (Students) 15 

Academic Administration to 

Total Time Effort to Grant Project 50% 



Figure 5, Example of Weivjhting Formula for Faculty 
Salary Calculation: Project Director 
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Factors Incl uded to Determine the Direct Cost of Instruction: 

Instructional Salaries 

0 Salaries for Teaching Faculty (STF) 

• Regular, Full-time Nursing Facuty 

• Special, Outreach Faculty 

0 Salaries for Other Instructional Personnel (SIP) 

• Clinical Preceptors 

• Teaching Assistants 

• Academic Consultants 

• Guest Lecturers 

• Thesis Advisors 

Academic Support 

o Salaries for Secretarial Support (SS) 

o Salaries for Student Wages (other than lnstructional)(SW) 

o Contractual Services (CS) 

o Equipment and Supplies (E&S) 

Travel 

0 Travel Expenses to Off-Grounds Sites (T) 

• Mileage Charges 

• Meals 
Lodging 

Direct Instructional Guidelines Per Student Credit Hour (SCH) 

STF + SIP + SS + SW + CS + E & S + T ^ 5CH = Total Direct Instructional 

Cost Per Student Credit Hour 

or 

Instructional Salaries + Academic Support + Travel Costs ^ SCH = 
Total Direct Instructional Cost Per Student Credit Hour 



Figure 6. Guidelines for the Determination of Direct Instructional 
Cost Per Student Credit Hour 
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Factors Included to Determine the Direct Cost of Instruction: 

o Typical Program Sequence - Courses, Credit 

Hours, Semester Taught 
o Cost Per Student Credit Hour by Semester 

Guidelines to Determining Average Direct 
Instructional Program Cost Per Student 

o For Each Course in the Typical Program Sequence - 

COST PER SCH BY SEMESTER x CREDITS AWARDED 

FOR E/iCH COURSE; 

o Calculate Total Course Cost for Each Area - 
MAJOR, SUPPORTING, MINOR; 

o TOTAL COST FOR MAJOR + TOTAL COST FOR 

SUPPORTING AREA + TOTAL COST FOR MINOR = 
AVERAGE DIRECT INSTRUCTIONAL COST OF 
OFFERING THE OUTREACH PROGRAM TO ONE 
STUDENT 
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Figure 7. Guidelines for the Determination of Average Direct Instructional 
Program Cost for One Student 
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were computed. This program cost was derived using the program re- 
quirements (i.e. courses and number of credit hours), and then multi- 
plying these credit hours by the average direct instructional costs per 
student credit hour taken from those semesters in which the course was 
taught. As described earlier, the Outreach Program has four curricu- 
lar components: major courses, supporting courses, minor courses, and 
elective courses. The program sequence requires 42 credit hours for 
students choosing an Administration or Education Minor and 39 credit 
hours for students participating in the Clinical Specialization Minor. Of 
these 39-42 credit hours, 2-3 elective hours were accepted as transfer 
credit since elective courses v^ere not offered in the Outreach Program. 
The average direct instructional program cost of offering the program 
to one student was based upon 36 credit hours (using the Education 
Minor), and excluded the cost of the elective course. As suggested 
earlier, this cost should only be used as a rough approximation of 
program expense as there are other costs which were not included in 
this computation. 
Findings and Discussion 

Using the- guidelines outlined in Figure 6, a direct instructional 
cost of $213,045.00 for the program is calculated as shown in Table 6. 
Using costs per student credit hour for each semester, an average 
direct instructional cost per student credit of $137.18 was calculated. 

Following the initial determination of direct instructional costs, and 
using the guidelines in Figure 7, the findings are presented in Figure 8 
for the average direct instructional cost of offering the program to one 
student. The average cost was calculated as $5,537 and consisted of: 
$1,662 for the major component, $2,331 for the supporting area and 
$1,544 for the minor area (education). 
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I . Major (13 credit hours) 

GNUR 572 - Primary Skills in Adult Health Seminar (4) 
GNUR 730 - Medical-Surgical Nursing Seminary (2) 
GNUR 731 - Medical-Surgical Nursing Practicum (2) 
GNUR 740 - Medical-Surgical Nursing Seminar II (3) 
GNUR 741 - Medical-Surgical Nursing Practicum II (2) 

Total Direct Instructional Cost for Major $ 1,662 



1 1 . Supporting Courses (18 credit hours) 

GNUR 562 - Basic Supporting Sciences (2) • 
GNUR 775 • Human Physiology I (3) 
GNUR 776 - Human Physiology II (3) 
GNUR 860 - Introduction to Research (3) 

(or EDRE 523 accepted for transfer credit) 
GNUR 861 - Research Design (3) 

GNUR 896 - Project Guidance (4) • 
(or) 

GNUR 898 - Thesis Guidance (4) 
Total Direct Instructional Cost for Supporting Courses $ 2,331 



III. Minor (6-9 credit hours) 

Administration (9) 

Education (9) 

Clinical Specialization (6) 

Total Direct Instructional Cost for Minor 



IV. Elective Courses (2-3 credit hours) 

Not taught in Outreach Program, transfer credits accepted 



$ 1,544 
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AVERAGE DIRECT INSTRUCTIONAL COST OF 
OFFERING THE OUTREACH PROGRAM TO 

ONE STUDENT $5,537 

This figure has been calculated using the Education Minor. 

This figure reflects the definition of "Direct Instructional Costs" 
as defined in this report. 



Figure 8. Program Cost From Outreach Program Sequence 
(39-42 credit hours) 
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Referring back to the direct instructional costs, it was interesting 
to note that expenditure? under the category of Academic Support com- 
prised 53% of the total direct instructional costs. This figure reflects 
the cost of 'starting-up* a new program, buying equipment and sup- 
plies, as well as some of the unique costs of an off-campus program. 
These unique costs include expenditures for long-distance telephone 
calls, a necessity for effective communication between the on-campus 
faculty and off-campus students, expenditures for duplicated material 
not locally available to students, and other expenses such as postage 
which were beyond the normal expenditure level of an on-campus pro- 
gram. 

The travel expenses for the Outreach Program constituted approxi- 
mately 9% of the total direct instructional unit costi>. This figure did 
not reflect the time that the instructional faculty spent on the roao (a 
round trip = 5-10 hours). Travel expenses may be misleading when 
expressed in monetary terms. The opportunity costs must be con- 
sidered in a program that demands up to two workdays of traveling time 
per week from participating faculty members. Certainly, tha cost was 
much greater than the salary assigned to the course and the travel 
expenses. Ideally, the monetary figure should be adjusted to reflect 
the cost of time for travelling--time, which would otherwise be spent 
more productively by the faculty members on other responsibilities. 

The cost figures also reflected the fluctuating enrollment, which 
was especially apparent in the first two semester (Fall 1977, Spring 
1978) of the program. The number of students enrolled in clinical 
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courses determined the number of clinical preceptors assigned to the 
students, which in turn determined an amount under the category of 
instructional support salaries. Unlike instructional faculty salaries, 
where course enrollment was not related to the salaries paid out, the 
clinical preceptor salaries varied according to the number of students 
assigned to a preceptor and the time spent with each student. Pre- 
ceptors were reimbursed at a fee of $10 per hour per student. 

For means of comparison^ cost data for the on-campus master's 
degree nursing program for the 1978-79 academic year were provided by 
the University of Virginia Office of Resource and Policy Studies. Per 
student credit hour cost was larger for the on-campus graduate nursing 
program and was computed at $212.98. Approximately two-thirds of 
that figure ($141.00) was attributable to faculty salaries. The remain- 
ing amount, 33% ($71 .00); was made up of additional direct costs 
(equipment, secretarial support, teaching materials) incurred as a 
portion of the instructional effort. 

The figure of $137 average direct instructional cost per student 
credit hour for the Outreach Program was made up of a 38% cost of 
instructional salaries ($52.00), 9% travel costs ($12.00), and 55% cost of 
academic support ($73.00). A graphic representation of these figures 
is shown in Figure 9. One explanation for the difference in faculty 
costs is that for the on-campus program, total expenses for maintenance 
of faculty (sal.^y, benefits, etc.) were charged as instructional costs 
regardless of the actual contribution to classroom teaching an individual 
made. In other words, 100% of the salarN of on-campus faculty was 
charged to instruction even though the faculty member may teach only 
one course and/or have administrative duties. In contrast, costs 
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Academic Support 
Instructional Salaries 
Travel 

Total Direct Instructional Cost 



53 % 
38 % 
9 % 
100 % 



Figure 9. Factors of Direct Instructional Cost 
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computed for the Outreach Program included only the portion of time 
individuals devoted directly to the instructional effort. Faculty costs 
may also differ due to the hiring of part-time faculty to teach specific 
courses in the Outreach Program. During those semesters when the 
Outreach Program was able to hire qualified instructional faculty from 
the southwestern Virginia area to teach courses (Spring 1978, Summer 
1978, Fall 1978, Spring 1979, two course sections for Summer 1980) both 
salary and travel costs were minimized. 

When Outreach students were required to come on-campus for the 
Summer 1979 session, with no instructional travel costs and increased 
enrollment, instructional costs were again minimized. In addition, the 
grants have absorbed many of the indirect instructional costs of the 
off -campus program. 

The in-kind (NC) services (faculty, support services and class- 
room space) provided to the Outreach Program greatly affected the 
costs of the program. The existence of these in-kind services reflected 
the commitment of th3 University and the cooperation of the south- 
western Virginia community but were not always guaranteed in an 
Outreach Program of this type. Without these in-kind services, a small 
Outreach Program, like a small institution, was forced to operate under 
a fixed overhead and was not able to take advantage of economies of 
scale. In addition, the nature of the Outreach Program introduced 
additional costs of travel and opportunity costs of travel. The clinical 
component of nursing education was essential, requiring additional 
clinical instructors and lower faculty-student ratios. 

Within the discussion of costing methodology, a note was made of 
various faculty members whose time was devoted to the program, but 
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who received no payments from the grant budget. These faculty mem- 
bers represented a salary expenditure that would realistically have to 
be supported by a program not in receipt of grant aid. Other adjunct 
faculty members might be willing to donate personal services as precep- 
tors regardless of the source of the funding. Other expenditures that 
were a normal part of either direct or indirect costs (i.e. rent or amor- 
tization paymen s for classroom space) were not reflected In the costing 
formula. 

The existence of services, facilities or materials which were do- 
nated "in-kind', i.e. where no iinancial transaction took place, points 
to the relative nature of costs and benefits. Resources like faculty 
time must nornally be purchased through a program budget. When 
those same resources were donated to the program they were no longer 
considered as costs, rather they became benefits to the program. 
However, they .vere reflected as costs in the budget of some program in 
the Institution. 

This Chan jing designation of a resource as either a cost (if paid 
for) or a bene-'t (if donated) raised two importaiit considerations to be 
made during ar analysis of the unit cost data now available. The first 
consideration \a3s that all the figures that have been computed were 
conservative. as mentioned earlier, it would be unrealistic to compare 
the Outreach Program costs with operational costs of other on-campus 
programs or of any future program which might have to purchase all 
necessary resoirces. The second consideration was that the language 
of "resources" and "expenditures" suggested an accountant's view of 
the educational process. Such a view was often simplistic and may tend 
to ignore the ccmplexity of the personal relationships within a program's 
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operation. Such a view also overlooked both benefits and costs which 
cannot be measured in financial terms. It is precisely because of the 
involvement of nurses and the educational community in the Outreach 
locations that the program avoided some usual costs and enjoyed bene- 
fits that flow from ccoperative support. The pay-off to the program 
and its graduates may be much greater, even though impossible to 
calculate financially, than if such services involved out of pocket ex- 
penses. 
Summary 

The determination of the financial costs of offering the Outreach 
Program was the focus of this section. The cost study was approached 
through a review of the relevant literature on the nature of costs in 
higher education and through c discussion of the costing terminology 
specific to the costing approach used in this project. Using guidelines 
discussed in this section the. methodology for the determination of 
average direct instructional costs per selected outputs were developed. 
The final part of this section included the actual computations for direct 
instructional unit costs as well as a discussion of the findings. The 
cost findings computed in this section were as follows: 

Direct Instructional Cost per Student Credit Hour $ 137.18* 

Direct Instructional Cost of Offering the 
Outreach Program to One Student 

(Education minor) $ 5,537.00* 

Direct Instructional Cost for Major $ 1,662.00* 

Direct Instructional Cost for Supporting Courses $ 2,331.00* 

Direct Instructional Cost for N-inor $ 1,544.00^^ 

All figures reflect an average cost. 
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SECTION V 
BENEFITS 

For the purposes of this report, a "benefit" of an educational 
program is definec as a positive result or outcome that can be antici- 
pated from experience or participation in the program. Benefits may be 
either direct or indirect, immediate or long-term. Short-term, direct, 
measureable benefits can also be called program outputs. Long-term, 
indirect, less-easily measured benefits can be called impacts. Though 
both impacts and outputs can be anticipated, more attention was given 
to outputs in the early evaluation efforts, as they are more accessible 
to examination and analysis. Later efforts will focus upon means of 
collecting data on the more speculative, potentially developing benefits 
which we have designated as impacts. 

The benefits of education affect va. ious groups. Discussion of the 
recipients of benefits will necessarily be limited by the same qualifica- 
tions we apply to the benefits themselves. In other words, short-term, 
direct benefits (outputs) will accrue clearly to the populations most 
directly involved in the educational effort, i.e. students and faculty, 
indirect benefits (impacts) will spread to educational institutions, com- 
munities, and society at large in addition to the primary participa.its. 
Background: Selected Literature 

The vast amount of literature describing the variety of potential 
benefits of education has no single focus. It discusses such expansive 
concepts as "transmission of culture" and "building foundation for 
democracy" and also treats very specific goals such as graduating morb 
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accountants, engineers, or veterinarians. Beneficiaries of education are 
described in global terms as "future generations" or in specific terms as 
"the baccalaureate class of 1980." In order to develop a focus within 
this range of benefits and beneficiaries, we chose to divide the infor- 
mation found in the literature into four types of benefits. One area 
around which a major segment of authors coalesce are economic issues. 
Another group of authors, while not oblivious to the implications of 
education to the economy of individuals or society, focus their thoughts 
on the benefits of education which are non-economic. Writers choosing 
either an economic or non-economic focus usually separate their treat- 
ment of benefits into those which affect individuals and those which 
have a broader impact on communities or society at large. The four 
treatments of benefits are then: personal and social economic benefits 
and personal and social benefits that are not economic. 
Economic Benefits: Personal 

From the end of World War II until the late I960's a single assump- 
tion dominated the argument for the individual economic benefit of 
highar education. That assumption was that for every year of addi- 
tional education, students could anticipate an increase in earning pow- 
er. Several major studies (Soloman, 1973) presented an empirical base 
for this assumption by relating both quantity and quality of economic 
achievement to higher income levels in later life. 

The traditional belief in the dollar and cents value of education 
has abated only moderately in recent years. People still believe more 
school now means higher income later. The results of a national survey 
published as recently as 1974 indicated that more than 95% of the par- 
ents of school age children believe that they should go on for post- 
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secondary schooling, and of that group more than 80% believed that the 
major benefit of such schooling would be training for a good (read: 
well-paying) job (Minor & Murray, 1974). 

Other literature has revealed challenges to the conventional wisdom 
linking education and earnings. Richard Freeman (1976) has argued 
that the economic benefit once insured to college graduates by a grow- 
ing labor market in demand of their skills (or credentials) has declined. 

In contrast to Freeman, other authors continue to argue that the 
economic value of education remains a major benefit to b'j considered 
(Bowen, 1977; Soloman, 1973; Taubman, 1974, 1979). Bowen's analysis, 
as late as 1977, concluded that "the monetary returns from higher 
education alone are probably sufficient to offset all costs" (Bowen, p. 
2). 

Economic Benefits: Social 

The most persuasive argument for social expenditures in support 
of education is expressed by the "human capital" thesis. This argu- 
ment relies on the language of economics and establishes its position by 
way of the metophor of investment. The first detailed treatment of the 
human capital argument was published by Gary Becker in 1964. The 
notion became a major rationale for supporting U.S. investment in 
education in underdeveloped nations as well as for continued buttress- 
ing of the U.S. educational system. 

Simply stated, the argument relies upon an analogy between physi- 
cal capital (factories, machinery, etc.) as a productive force within 
society and human beings aS' another source of productivity. Within 
this analogy, a given financial investment in physical capital is seen as 
producing a measureable rate of return. The value or such investments 
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(or their benefits) can be calculated by subtracting the costs of pur- 
chasing and maintaining, for example, a new machine, and the eventual 
profits (in materials produced, efficiency, etc.) it will yield. 

We can invest in the future productivity of the members of society 
by educating them, say the proponents of the human capital theory. 
How valuable such investments are depends on the cost of education 
which include support of an educational system as well as loss of school 
age people from the work force as measured against their eventual pro- 
ductivity as wage earners. While it is true that human capital theorists 
often mention non-economic returns on educational investments, the root 
of the metaphor is economic and relies on an investment strategy and a 
social profit motive. 
Non-Economic Benefits: Personal 

Similar though not as extensive problems of measurement apply to 
the benefits individuals gain from education. Advances in psycho- 
metrics now allow for changes in knowledge and attitudes to be assessed 
and for the skills resulting from some types of education to be mea- 
sured. Perhaps the most extensive taxonomy of these benefits has been 
developed by Oscar Lenning and his associates working at the National 
CeaCer for Higher Education Management Systems. Lenning's work 
(1974, 1977, 1978) encompasses not only a theoretical and conceptual 
discussion of benefits, but also a bibliographic compilation of most 
previous literature in the area. To this listing he has added his own 
taxonomy of benefits. These lists include factors which are academic 
and intellectual; social and interpersonal, psychological and emotional, 
vocational, aesthetic, philosophical, moral, and religious. The list 
below samples a few of the individual benefits which are seen as re- 
s Jiting from education. 
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1. 


Expansion of personal knowledge 


2. 


Ability to think critically 


3. 


Increase in self-esteem, self-confidence 


4. 


Acquisition of identity with vocational credentials 


5. 


Ability to enjoy aesthetic events more fully 


6. 


Increase in personal autonomy 


7. 


Development and clarification of personal values 


8. 


Higher social status 


9. 


Satisfaction from better job skills 


10. 


Ability to improve through self-critique 



This list represents a small group of benefits derived from the tax- 
onomy proposed by Oscar Lenning. 
Non-Economic Benefits: Social 

Economic benefits are among the more easily quantifiable results of 
education. For this reason, while not forgetting the motivational value 
of financial arguments to both individual and governments, the amount 
of research focusing on financial reward has been significant. Some 
authors, however, have reacted against the reductionism that economic 
analyses imply. They argue that the value of education is impossible to 
quantify and that more attention should be given to the benefits we 
cannot measure by dollars and cents. Characteristic of such authors is 
Louis Benezet (1971). 

Bene:^et*s appeal to the general, non-economic social benefits which 
flow from education is echoed by other writers (Bowen, 1977; McGrath, 
1980; Witmer, 1978). These writers often point to results such as 
reducing crime or improving health which also appear in the lists of 
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economic benefits. They list these results as ends in themselves that 
will provide a better general "quality of life," rather than as a means 
toward financial reward. 
Graduate Nursing Education 

Nursing education is part of higher education. As such it shares 
many of the potential benefits which are expected as outcomes of all 
higher education. There are, however, significant differences in the 
benefits which can be anticipated from diploma, associate, or baccalaur- 
eate level nursing programs and programs at the graduate level. All 
three of those paths (diploma, ADN, BSN) end with the professional 
credential qualifying the recipient for the duties, responsibilities, and 
rewards of nursing practice. Graduate levol nursing education has 
additional and even more focused objectives to meet and more benefits 
to be expected. 

An historical review of the nursing literature reveals that graduate 
level programs were initially developed tc Prepare either educators to 
teach in college level nursing programs or administrators for nursing 
care settings. In the last few years, however, the major benefit ex- 
pected by students in graduate programs was the acquisition of skills in 
clinical specialties. While the option of becoming an educator is ctill 
important, many feel that study of specialized areas from both the 
academic and clinical perspectives will increase the knowledge base 
available to the nurse whose service in a clinical setting will then be 
improved. This observation supports the con'.antion that while the 
master's degree in nursing is primarily of functional benefit to most 
graduates who will practice in clinical settings it has the additional 
value of preparing some for an academic role as teacher or researcher. 
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The professional focus of the graduate degree parallels the function of 
most such degrees even in traditionally "liberal arts" areas, as has 
been indicated by analysts of higher education for some years (Berel- 
son, 1960). 

Benefits to be expected from graduate nursing programs include 
specific ro!e preparation in four areas: 

1. As a clinical specialist; 

2. As an educator (teacher or researcher); 

3. As a manager or administrator; 

4. As an agent of change within complex organizations (McLane, 
1978). 

■'"he benefits of such role development would presumably flpw to grad- 
uates as well as to their employees and those they would serve in the 
Vririous situations of employment. 

Sc ^ studies have shown that some students enter a master's pro- 
gram as a preliminary for doctoral study or simply because the program 
offers them another opportunity for continuing education (Parsons, 
1979). Graduates themselves have pointed to such benefits as: devel- 
oping an enhanced professional identification; increasing ability in 
problem solving; having timely access to the moral support of faculty 
and other students for career decisions; and obtaining a more balanced 
perspective toward the variety of skills which are necessary to nursing 
(Crandall, 1976). Other writers have suggested that both individual 
graduates and the nursing profession in general will benefit from the 
prestige of nursing vis-a-vis other health fields as increasing numbers 
of nurses hold graduate degrees. The benefits in this case relate not 
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only to the prestige attached to the higher degree, but also to the 
shared base of general education which will allow the development of 
further relationships with health care providers in other disciplines 
(Galambos; 1979). 

The national organizations which represent nurses have issued 
several policy statements about the particular aims of master's level 
nursing programs. Both the National League for Nursing (NLN) and 
the American Nurses Association (ANA) stress "preparation of leaders 
in nursing" as the essential m.otive of graduate programs (Lodge, 1977). 

The NLN identifies nine specific student benefit opportunities 
which can be gained from master's level study. They are: 

1. To acquire advanced knowledge to support advanced nursing 
practice; 

2. To expand student knowledge of nursing theory as a basis 
for advanced practice; 

3. To develop expertise in a specialized clinical area; 

4. To acquire knowledge and skillls for a specific functional role 
in nursing; 

5. To acquire initial competence to conduct research; 

6. To plan and initiate change in the practice and delivery of 
care within the health care system; 

7. To develop and implement leadership strategies to improve 
health care; 

8. To engage in collaborative relationships to improve health 
care; 

9. To acquire a foundation for doctoral study (NLN, 1979). 
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These aims or objectives are potentially beneficial not only to students 
but also to the institutions and communities where they will work. 
Beneficiaries of Graduate Nursing Education 

During the planning stage of the program evaluation, the decision 
was made to focus on the four groups most directly involved in program 
implementation and most affected by program results. These groups 
were students, faculty, the nursing school and the Outreach Program 
area communities. Each of these groups is listed below into a list of 
benefits they might reasonably expect to derive from the Outreach 
Program. 

Students. The direct beneficiaries of education are students. 
Because this program has specific vocational aims, the list below is 
arranged according to the obvious outcomes students can expect to 
result from their participation. Students completing the program will 
receive two immediate outputs. First, the accumulated knowledge and 
skills which are the objectives of instruction. Second, the degree 
which symbolizes those factors and becomes the credential representing 
the holder's abilities to the profession and the public. The benefits 
which can be inferred from these two outputs are listed below: 

1 . Economic 

a. Access to higher paying positions; 

b. Possible promotion in current position; 

c. Long-term financial security through job mobility; 

d. Better credit as a result of perceived professional status; 

e. Improved likelihood of long-term career advancement. 
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2. Vocational 

a. Certification to teach, become an administrator or assume 
expanded clinical responsibilities; 

b. More autonomy in current job; 

c. Heightened feeling of confidence in current job; 

d. More prestige with other professionals end with work 
peers; 

e. Impetus to work for an expanded role to use new know- 
ledge and skills in current job; 

f. Opportunity to develop professional relationships with 
program faculty; 

g. Satisfaction from contribution to the quality of health 
care in the area; 

h. Likelihood of becoming a leader in a local health care 
system and in a professional organization; 

!. Development of skills to do research and enhance posi- 
tion in existing teaching job; 
j. Certification to undertake doctoral studies; 
k. Efficiency in performing general nun ing duties. 

3. Personal 

a. . Satisfaction of achievement in completing advanced stud- 

ies; 

b. Supportive relationships developed with peers in program; 

c. Increased prestige with family and community; 

d. Better understanding of role and own potential as a 
nurse; 

e More favorable self-concept. 
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The economic, vocational and personal benefits listed above are all 
anticipated results which should follow the acquisition of n^^w knowledge 
and skiM and the awarding of a graduate nursing degree. 

Faculty, Benefits for the program faculty pertain generally to the 
teaching, research, and service functions which all Universitv faculty 
share. Additional benefits such as those having an impact on career 
development are: 

a. Opportunity to work with graduate-level students; 

b. Opportunity to develop additional research materials and 
publications (professional development); 

c. Improvement of personal understanding of graduate-level 
nursing; 

d. Consequent improvement in on-campus teaching techniques; 

e. Exposure to heterogeneous student body with backgrounds 
and needs differing from the usual on-campus student popu- 
lation; 

f. Exposure to more "practically oriented" nurses with work 
experience "in the field"; 

g. Opportunity to act as agents of change in extending new 
ideas and knoweldge at the local level; 

h. Expanded contact with planners and deliverers or health care 
(i.e., extending professional contacts): 

i. Opportunity for more involvement in planning, managing, and 
evaluating an educational program; 

j. Exposure to the unique needs of a rural patient population. 
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This group of potential benefits to faculty members covers a wide range 
of possible results. They could be expected to accrue to individual 
faculty r. 'mbers in different measure, depending on the level of in- 
volvement and type of task to which each faculty member was assigned. 

Nursing school and university . Potential benefits that could 
accrue to the Nursing School and the University of Virginia are listed 
below: 

a. Ability to araw more faculty desiring contact with graduate 
students'. 

b. Opport; Aty to demonstrate service to previously underserved 
region 

c. Additonal income through grant support; 

d. Potential for future revenues in tuition and fees; 

e. Improvement in on-campus instructional program through 
feed-back from remote -site teachers; 

f. Development of more sophisticated information on graduate 
nursing in general; 

g. Opportunity to develop cooperative arrangements with other 
schools, hospitals, etc. in the program reg'on; 

h. Establishment of a regional training center which could be 
used in the future as a unique care setting for on-campus 
students. 

This group of benefits speaks to administrative expectations of those 
who plan off-campus programs. 

Community . Community, in this section, includes both the general 
population s rround'ng the southwestern Virginia program, as well as 
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the more specific community of nurses and other members of the local 
health care system. A few of the benefits community members could 
anticipate are listed below. 

a. Existence of a local graduate program allows the already 
functioning nursing population to remain in residence while 
expanding skills; 

b. Leaders are developed for the local health-care system; 

c. Teachers are produced (and certified) to assist in baccalaur- 
eate, associate degree and diploma programs. 

Methodology 

The data collection efforts concerning actual program benefits 
concentrated upon four groups of people. Each group participated 
either in the planning and long-term oversight of the Outreach Program 
or was involved in the daily detail of teaching or studying. The four 
groups were those listed above: program students (both those com- 
pleting degrees and those who had left the program after enrollment), 
program faculty (on and off-campus), Nursing School administrators, 
and Advisory Committee members living in Southwest Virginia. 

Benefit surveys were developed using the lists of potential benefits 
that had been derived from the educational literature (see above). 
Each survey was targeted to a specific respondent group (students, 
faculty, nursing school administrators. Advisory Committee). An inter- 
view protocol was also developed for use after the completion of benefit 
surveys. 

Thirty-seven students were surveyed and interviewed during the 
evaluation project. Thirty-one of those students are scheduled for 
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successful completion of the progran^; six were enrolled at the program 
outset and left for a variety of reasons. Seventeen faculty members 
were surveyed and interviewed. Eleven of ihsm were resident faculty 
at the University of Virginia, six taught in the program on a part-time 
basis. The remaining faculty were employed at other insti\:utions lo- 
cated in the program area. Advisory Committee members who ren'^ained 
in touch with the program from the planning phase through stuoent 
graduation were contacted. They numbered thirteen. Finally, three 
members of the School of Nursing administration provided data on the 
Outreach Program. 

In summary, 100% of the active students and the same percentage 
of those faculty who were included in off-campus instruction were 
contacted as part of the evaluation. In addition, the Nursing School 
admin istrtitors responsible for the Outreach Program were contacted, as 
were a sampling of Advisory Committee members and students no longer 
active in the program. 

In the Fall of 1980, benef.t surveys were mailed to each of the 
four Outreach participant groups. As the surveys were returned to 
Charlottesville, an interview schedule was developed which allowed 
evaluation staff members to travel to Southwest Virginia in the Spring 
of 1981 for personal interviews with each survey respondent. Each 
individual was encouraged to expand on the list of benefits received 
from the Outreach experience, to explain both the financial and per- 
sonal costs of the program, to enumerate any specific problems occur- 
ring within the program, and to offer recommendations for program 
improvement. The interviews and all survey data remained confidential 
to the evaluation team. All data which resulted from surveys and 
interviews were reported in aggregate form only. 
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Interviews also included a discussion of the benefits not listed on 
the survey, unique problems and costs of the program, and recommen- 
dations for program improvement. The lists of "other benefits," in- 
cluded here are the result of an analysis of interview responses. Items 
which appear may be considered representative of the general const iSus 
of respondent opinion. 

As noted above, advisory committee members were surveyed and 
then interviewed to ascertain their perceptions as representatives of the 
communities in which Outreach Program graduates work. Their involve- 
ment in the program ranged from the casual interest of a potential 
employer of graduates to the more tstoroughly involved teachers who 
volunteered their services 3S preceptors during the teacher training 
and clinical practicum components of the curriculum. While the partici- 
pation and cooperation of advisory committee members were crucial to 
the success of the program, their role demanded less time and contact 
than did that for students or faculty. Their comments are short in 
relation to the other groups. Additional comments may be expected 
from them later, when long-term impacts of the program are assessed. 

Three people from the School of Nursing were involved in admini- 
strative positions related to the Outreach Program. Their perceptions 
of the benefits, costs, and negative outcomes of the program were 
generally uniform, and repeat many opinions of the faculty in general. 
Findings and Discussion 

The data collected during the survey /interview phase of the eval- 
uation project were included below. A list of benefits from the survey 
of each respondent group was provided. Items from the survey<= were 
reported in priority order, i.e., those items selected as most important 
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by each group were listed first. Survey instruments and the interview 

protocol were included \p the appendices. 

Students 

. Benefits . The table that follows (Table 7) displays details of 
survey responses from ^thirty-two active students. A graphic de- 
scription of the survey responses is shown in Figure 10. The highest 
priority benefit for this group was: potential for long-term career 
advancement. Other benefits were listed in order of the number of 
respondents who answered them positively. ' 

Interview Responses . During interviews, benefits which students 
oiaipentioned in addition to those on the survey fell into several categor- 
ies. Broadly^ conceived, these categories could be described as. gen- 
eral, specifically job related, professional and personal. ^ 

General benefits included the following: the program provided an 
opportunity to learn from other students with varied backgrounds and 
work experiences; relationships with other highly motivated . students 
provided a built in program "si^pport group" which will continue after 
program completion; generally better working relationships with other 
health professionals resulted from involvement with Outreach. 

Job related benefits included the following: theories and tech- 
niques learned in school could be applied to an ongoing practical job 
situation; the unique structure of the proprara^llowed students to work 
full-time and simultaneoi'.sly pursiie a graduate degree - without a 
locally offered program this would never have been possible. 

Professional -benefits included the following: students were equip- 
ped to be agents of change within the local nursing community; J:he_ 
general perspective on the profession was broadened by more exposure 
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Table 7 
Student benefits 



Syfits 



Rjink 
Priority 



Number of*^ 
Positive ' 
Rtsponsts 



Perc«nUy« of 

all r«spond<Knts 
checking this 
ittm 



It Is llktly that my chances for 
carter advancament ovar tha 

long*tarm will improva. 

I will banafit from tha pro- 
fassional relationships I hava 
developed with Outreach 
program faculty. 

My education will give me a 
feeling of satisfaction as 1 
improve the quality of nursing 
care in this area. 

I will be certified to teach, 
become an administrator or 
assume more clinical 
responsibility. 

1 will be qualified for more 
different jobs, and will feel ^ 
more secure financially. 

I will be qualTfied for 
higher paying Jobs. 

I wil! be motivated to work for 
an expended role to use my 
new skill and knowledge In my 
current Job. 

I will be generally more efficient 
In performing my general duties 
as a nurse. 

I will feel more confident about 
my current Job. 

My n«w degree will add to my 
prestige at work and with other 
nurses. 

The research skills I have 
developed will enhance my value 
in my current teaching job., 

I will be qualified to go on 
for doctoral study. 

I will be more likely to become 
a leader In my local nursing 
organization. 

i will have more independence 
In my current Job* 

I will expect a promotion in my 
-current-job. 

My financial credit will improve 
-with- a new professional stature. 



10 

11 
12 

13 
14 

15 

-16^ 



32 
30 
28 

26 

25 
22 • 

22 

22 
20 

18 

18 
14 

9 
8 

6 _ 
2 



100% 



94% 



81% 

78% 

69% 



63% 

56% 

56% 
44% 

28% 
25% 
19% 
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Figure 10. Benefits Perceived by Students 
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to nursing theory and literature; students learned to use area health 
and education resources more efficiently; students were prepared to be 
preceptors in nursing baccalaureate programs which might come to the 
area. 

Personal benefits included the following: independence as a learn- 
er was enhanced; confidence for job seeking was heightened; general 
assertiveness increased; an expansion of personal perspectives was a 
stimulation to pursue other areas of interest professionally and academ- 
ically. 

Students not Completing Outreach . The preceding list of respons- 
es summarizes the perceptions of most of the students who participated 
in the Outreach Program. However, several other students who began <5r 
the program but did not complete it listed unique benefits. 

Additional training which would improve their professional creden- 
tials and feeling of satisfaction at improving the quality of nursing care 
in the region were- the two benefits considered as most important to 
students who left the prcjgram. Other items not previously listed for 
the enrolled student group were: the program raised the awareness of 
students to previously , unconsidered educational goals; while students 
left the Outreach Program for a variety of personal and professional 
reasons, many were motivated by the Outreach experience to enroll in 
other programs closer to home, and several finished their degrees full 
cime on-campus in Charlottesville. 



Outreach 

^ , ' 84 

Faculty . ^ < ^ , 

^ Benefits. The table that follows (Table 8) displays ' details of 
survey responses from seventeen facultV members who participated in 
instruction during the Outreach Program. The survey responses were 
also graphically depicted in Figure 11. Highest priority benefits to 
them were the opportunity to be an agent of change and exposure to a 
heterogeneous student body. 

Interview Responses . Benefits which faculty mentioned in addition 
to those on the survey fell into two types: benefits which could be 

# described as personal and benefits'^ relating to the service function 
faculty fulfill as members of the School of Nursing. 

Two personal benefits were mentioned:- many factilty members 
welcomed the opportunity to work with students who were unusually 
motivated and grateful to be involved in the Outreach Program; and 
some off-campus faculty felt that their participation in a University of 

, Virginia program gave them j an enhanced credibility at their parent 
institutions. 

Three service- related benefits were mentioned: a feeling of 
achievement from having contributed to a long-term goal of community 
service; satisfaction at filling an educational need in the program region 
and making an impact upon the quality of health care in the area; and 
pride at be'ng^able to improve the image of the School of Nursing. 
School of Nursing ^ 

Benefits . Three administrators from the School of Nursing were 
surveyed and interviewed to collect data on actual benefits to the 
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Table 8 
Faculty Benefits 



Rank 

Benefits ? 'Priority 


iNUmDcr or 

Positive 
Responses 


Percentage of 
ail responuencs 
checking this 
item 


Opportunity to act as agents of 
change in extending new ideas 
and knowledge at the local level. 


1 


13 


77% 


Exposure to heterogeneous stu- 
dent-body with/' backgrounds and 
needs differing from the usual 
on-campus student population. 


2 


IK 


65% 


Opportunity to work with 
graduate-level students. 


3 


11 


65%' 


Expanded contact wit)i plan- 
ners and deliverers of health 
car© (i.e., extending profes- 
sional contacts). 


4 


10 


59% 


Improvement of personal 
understanding of graduate- 
level nursing. 


5 


10 


59% 


Exposure to more "practically 
oriented" nurses with work 
cPspci icncc in tne iieiQ . 


0 


9 


53% 


* 

Opportunity for more involve-1 
ment in planning, managing, 
arrd evaluating an educational 
program. 


7 


Q 
O 




Exposure to unique needs of 
a rural patient population. 


8 


6 


35% 


Opportunity to develop addi- 
tional research materials end 
publications (professional 
development) 


9 


3 


1C% 


Consequent improvement in 
on-grounds teaching techniques.^ 


10 


3 


18% 
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Figure "Jl- Benefits , Perceived by Faculty 
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Schoor and the University resulting from the Outreach . Program. The 
• following table (Table 9) details their responses to the survjsys. High- 
est^ priority items included the opportunity to develop cooperative 
9xrangements with other schools and hospitals and the, opportunity to 
demonstrate service to a previously uhderserved area. 

Interview Responses , The five major benefits mentioned by the 
.administration and not appearing on the benefit survey are listed below: 
the program provided an opportunity to try out new curricular ideas; 
the program enhanced the image of the- University and the School^ of 
Nursing; the major objective of the Outreach Program, to produce 
masters level nurses for Southwest Virginia, was deemed a success; the 
general edu'cational leveh ot nurses in the state would be raised as a 
result of the Outreach Program; the regional consciousness of the need 

for baccalaureate level programs was raised in the program region, 
♦ 

Community 

Benefits . Thirteen members of the Advisory Committee provided 
survey and interview data. Their responses to surveys were t5bulated 
below in Table 10 and graphically depicted *In Figure 12. They listed 
two benefits of highest priority to their community: the existence of a 
locally based graduate program and the production of teachers for 
ongoing nursing programs. 

Interview Responses: Community . In addition to the. benefits 
suggested by the survey form^ members of the advisory committee 
mentioned the following three benefits: the cooperative arrangements 
between the University and ^schools oi hospitals in the program region 
were a crucial component to the ^program's smooth .operation. Advisory 
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". Nurslrfg School Benefits 



" 1 

'Rapk 

Benefits 'Priority 


INUiIiiJCf Ul 

Positive 
Responses 


Percentage of 

oil IC^^WIIUdlvO 

checking this 
item 


Oplportunity to develop coopera- 
tive arrangements wjth otiier ^ 
schools, hospitals, etc. in the • 
program region. 1 


• 

" 3 


100% ' 


Opportunity to xlemonstrate 
service to previously under- 
served region* 


2 


• 

3 


100% 


Additional income t+irough 
grant support « 


3 


2 


- 67% 


Establishment of a regional train- 
ing center which could " be used 
in the future as a unique care 
setting for on-grounds students. 


4 


1 


• 

33% 


« 

Ability to draw more faculty 
desiring contact with graduate 
students. 






*% • 

* 


Potential for future revenues 
in tuition and fees. 


6 


0 


A 


Improvement in on-grounds 
instructional program through 
feedback from remote-site 
teachers . 


7 ■ 


A. 

0 




Development of more sophisti- 
cated information on graduate 
nursing in general. 


8 


0. 
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^ Table 10 



Community Benefits 



Percentage of 

* Number of ^ all respondents 

Rank Positive checking this 
Benefits Priority Responses . item 



Existence of a local graduate 
program allows the already func- . 
tionifig nursing population to 
remain^n residence while 

expanding skills. i 13 -|00% 

Teachers are produced (and ^ 
certified) to contmue this pro- 
gram and assist in 'baccalaureate * 
associate degree and diploma 

programs. 2 TO - , 77% 

Nurses "in the field'* have access 
to program offering as' a source 

of continuing education.- 3 ^ 10 77% 

General quality of nursing care 
is improved by practitioner 

training.. ' ^ 4 6 ^ 46%. 

A -generally more productive 

force of working nurses. 54" 31% 

Particular concepts and tech- • " " 

niques unique to the rural 
setting may be oroduced by the . 
research efforts of the program * 

graduates and Tacultyl 6 4 31% 

Range of nursSng services are- 
expanded by diffusion of clinical 
specialty skills to local graduates 

and faculty. '74 31% 

Trained admlnistratoj^s are devel- • 

oped for local nursing institutions. 8 3 23% 
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